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Description 

Technical Field 

[0001] The present invention relates to a method and apparatus for making a code book, a vector quantizing 
device, a device and method for data compression, a device and method for data decompression, a system for data 
compression/decompression, which are used for vector quantization, and a recording medium which stores a progran 
for executing these processes or a code book having a predetermined data structure. 

Packgrpund Art 

[0002] Various data compressing methods have been conventionally proposed. Of these methods, a method called 
"vector quantization" is well known as a data compression algorithm capable of very easily decompressing compressed 
data. This algorithm is known in the field of signal processing for a long time and particularly applied to data compres- 
sion of an image or voice signal, or pattern recognition. 

[0003] In this vector quantization, some pixel patterns (codes) each having a certain size (e.g., a block of 4 x 4 pix. 
els) are prepared and respectively assigned unique numbers (this set is called a code book). For example, blocks hav- 
ing the same size (e.g., 4x4 pixels) are sequentially extracted from two-dimensional image data, and a pattern most 
similar to each block is extracted from the code book, and the pattern number is assigned to the block, thereby com- 
pressing the data. In vector quantization, a data string in one block corresponds to one vector. 
[0004] Fig. 28 is an illustration of the schematic construction of a conventional vector quantizing device. Referring 
to Fig. 28, an original image input by an image input unit 301 is supplied to a compressing unit 302 using a code book 
scheme. The compressing unit 302 using the code book scheme executes vector quantization processing, which will 
be described below, for the input original image using a number of pattern images (e.g., images each comprising a 
block of 4 x 4 pixels) which have been registered in a code book storage unit 303 as a code book in advance. 
[0005] When the input original image is a still image, the compressing unit 302 using the code book scheme per- 
forms the following processing for the single still image. When the input original image is a moving picture, the following 
processing is sequentially executed for each frame image. 

[0006] More specifically, starting from the upper left corner of the original image, 4x4 pixel blocks are sequentially 
extracted toward the right When the extraction position reaches the right end, it is shifted to the lower side by one block, 
and blocks are extracted from the left end again. This is repeated to extract blocks of the entire window. 
[0007] For each extracted block, a code vector having a pattern most similar to the block is selected out of many 
code vectors registered in the code book storage unit 303, and its corresponding code number is output. For example, 
when an image having 640 x 480 pixels is processed, 19,200 blocks are extracted and processed, so the number of 
code numbers to be output is also 1 9,200. 

[0008] On the receiving or decompressing side of thus coded compressed data, the original image can be recon- 
structed only by extracting a pattern corresponding to the code number from the code book for each block. Hence, when 
the decompressing side has received or holds in advance the code book, the original image can be reconstructed by 
very simple hardware because no special arithmetic operation is necessary. 

[0009] Subjects of the above-described vector quantization are, for example, in data compression of an image, how 
to obtain a high-quality reconstructed image while holding a high compression ratio, and how to make a code book with 
high performance, which is always required for execution of vector quantization. More specifically, because of the char- 
acteristics of vector quantization, the quality of a reconstructed image is closely related to the quality of a code book 
used. Hence, for example, to obtain a high-quality reconstructed image while holding a high compression ratio in data 
compression of an image, how to make a high-performance code book is a subject. 

[0010] Conventionally, to optimize the code book, some methods are known, represented by the Kohonen self- 
organizing map method. In these methods, a code book is optimized by performing appropriate mathematical expres- 
sion processing using; e.g., a sample image. However, in the conventional optimizing techniques, a resultant code book 
is useful for only data used for optimization. 

[001 1 ] More specifically, a code book optimized using image data of a person's face is the best code book for the 
image used for optimization. However, the code book is not always the best for other images. For example, when image 
data of another person's face is compressed using the code book, the quality of the image reconstructed from the com- 
pressed data deteriorates. 

[0012] In addition, although a relatively high quality is obtained for a reconstructed image included in the same cat- 
egory "human face" as the image used for optimization, the image quality often degrades for an image in a different cat- 
egory such as "landscape" or "character". That is, since patterns included in the code book vary with images, the code 
book is not so versatile. 

[0013] To obtain a satisfactory quality for a reconstructed image regardless of the category of images, a method is 
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available in which a code book is optimized using various kinds of sample images, and all resultant code books are reg- 
istered. In this case, in actually executing vector quantization, since code books matching images in various categories 
including "human", ■landscape", and "character" are prepared in advance, a pattern close to the original image can be 
selected out of them. 

5 [0014] In this case, however, the number of codes to be prepared in advance is enormous, and the capacity of a 
memory for storing them becomes very large. When the memory capacity becomes large, the scale of the entire appa- 
ratus also becomes large, resulting in difficulty in downsizing. In addition, since the cost also increases accordingly, 
employment of this method is impractical. 

[0015] The above optimizing technique also has a problem that which types of patterns are included in the opti- 
10 mized code book cannot be known. 

[0016] The present invention has been made to solve the above problems, and aims to realize a greatly versatile 
code book compatible with various kinds of images. 

[0017] It is another object of the present invention to realize a greatly versatile code book without increasing the 
capacity of a memory for storing the code book. 
15 [001 8] It is still another object of the present invention to make it possible easily to recognize which kinds of patterns 
are included in an optimized code book. 

[0019] In executing vector quantization, as described above, search processing for finding a code vector having a 
pattern similarto the vector data of an original image from a code book must be performed. As a means for determining 
whether two units of vector data are similarto each other, conventionally the two units of vector data are input to a pre- 
20 determined function and calculated to express the similarity between them as a numerical value, and determination is 
done on the basis of the magnitude of this numerical value. 

[0020] As the predetermined function, a function for obtaining the Manhattan or Euclidean distance between the 
two units of vector data input is used. The Manhattan distance is obtained by calculating the absolute difference value 
between the two units of vector data input for individual elements and adding all absolute difference values calculated 
25 between the elements. The Euclidean distance is obtained by calculating the square-sum of such absolute difference 
values described above. 

[0021] Fig. 29 are illustrations for explaining the problem of the prior art in which a code vector is searched for by 
obtaining similarity using such a method. Figs. 29(a) and (b) show parts of a reconstructed image reconstructed by 
embedding code vectors (pattern images of blocks) obtained by vector quantization, in each block. Squares shown in 

30 Fig. 29 correspond to individual blocks. 

[0022] Fig. 29(a) shows a case wherein, although the original image (not shown) before compression is an image 
in which the entire luminance gradually changes in a direction (indicated by the large arrow) from the lower left block to 
the upper right block, the reconstructed image includes blocks having a pattern which changes the luminance in the 
opposite direction (indicated by the small arrows). Fig. 29(b) shows a part corresponding to an edge in the recon- 

35 structed image, though the edge portion is not satisfactorily reconstructed. 

[0023] As described above, in the conventional vector quantizing technique, both the image whose luminance value 
gradually changes and the image whose luminance value abruptly changes are reconstructed as unnatural images for 
which a man has the sense of incompatibility for embedded patterns. 

[0024] As one cause, since the conventional code book is not made in consideration of a pattern whose luminance 
40 value gradually changes or a pattern whose luminance value abruptly changes, as described above, a pattern image 
suitable to each image is not always included in the made code book. 

[0025] As another probable cause, in conventional vector quantization, similarity is independently calculated for 
each block, and the similarity is obtained by calculating using information on all pixels in* the block. More specifically, 
although code vectors having various patterns are included in a code book, the similarity to an Input vector extracted 

45 from the original image is given for each block on the basis of the sum of absolute difference values for each pixel. 
[0026] Hence, even a pattern whose luminance direction is opposite to that of the entire image is selected when the 
calculated similarity is larger than that for other patterns. That is, even when a code vector having a pattern image more 
natural as a whole is included in the code book, not this pattern but an unnatural pattern image is sometimes selected. 
When blocks with such pattern images are locally included in the reconstructed image, those who see the image have 

so the sense of Incompatibility. 

[0027] The present invention has also been made to solve this problem, and aims to make it possible to obtain a 
high-quality reconstructed image by reliably searching for a pattern image suitable to the human visual characteristic. 

Summary of t he Invention 

55 

[0028] A method of making a code book used in vector quantization according to the present invention is a method 
of making a code book used in vector quantization, said code book comprising a set of code vectors each of which is a 
data string including at least one unit of data, characterized in that a data string of a code vector is made with reference 
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to one or more units of data In the data string constituting the code vector, by giving, to the remaining units of data in 
the data string, values which vary from the reference data value in order by a predetermined increment. 
[0029] Another aspect of the present invention is directed to a method of making a code book used in vector quan- 
tization. The code book comprises a set of code vectors each of which is a data string including at least one unit of data. 
5 The method is characterized in that a data string of a code vector is made by the manner that the data string constituting 
the code vector is classified into data groups, the total range of the possible values of the respective units of data in the 
data string is divided by the number of classified data groups, and an arbitrary value in the divided range corresponding 
to the data group is selectively assigned as each data value in each data group. 

[0030] Still another aspect of the present invention is directed to a method of making a code book used in vector 
10 quantization. The code book comprises a set of code vectors each of which is a data string including at least one unit 
of data. The method is characterized in that a data string of a code vector is made by the manner that the occupation 
rate of the maximum or minimum value of the possible values of the respective units of data in the data string constitut- 
ing the code vector is set, the maximum or minimum value is assigned to arbitrary units of data constituting the data 
string in accordance with the set rate, and the minimum or maximum value is assigned to the other units of data than 
15 the units of data to which the maximum or minimum value is assigned. 

[0031] An intermediate value may be assigned to predetermined units of data in accordance with the arrangement 
state of the units of data to which the minimum value is assigned. 

[0032] According to still another aspect of the present invention, the method is characterized by including at least 
two of the above-described three code book making methods and characterized in that code books made by at least 

20 two methods are combined to make one code book. 

[0033] An apparatus for making a code book used in vector quantization of the present invention is an apparatus 
for making a code book used in vector quantization, said code book comprising a set of code vectors each of which is 
a data string including at least one unit of data, characterized by comprising: reference value setting means for setting 
a reference data value to one or more arbitrary units of data in a data string constituting a code vector; increment setting 

25 means for setting an increment with respect to the reference data value; and code vector making means for making the 
data string of the code vector as a set of data values obtained by sequentially changing the set reference data value by 
the set increment. 

[0034] Another aspect of the present invention is directed to an apparatus for making a code book used in vector 
quantization. The code book comprises a set of code vectors each of which is a data string including at least one unit 

30 of data. The apparatus is characterized by comprising: data classifying means for classifying a data string constituting 
a code vector into data groups; range dividing means for dividing the total range of the possible values of the respective 
units of data in the data string by the number of classified data groups; and code vector making means for making the 
data string of the code vector by selectively assigning, as each data value in each classified data group, an arbitrary 
value in the divided range corresponding to the data group. 

35 [0035] Still another aspect of the present invention is directed to an apparatus for making a code book used in vec- 
tor quantization. The code book comprises a set of code vectors each of which is a data string including at least one 
unit of data. The apparatus is characterized by comprising: rate setting means for, in a data string constituting a code 
vector, setting the occupation rate of the maximum or minimum value of the possible values of the respective units of 
data in the data string; and code vector making means for making the data string of the code vector by assigning the 

40 maximum or minimum value to arbitrary units of data constituting the data string in accordance with the set rate and 
assigning the minimum or maximum value to the other units of data than the units of data to which the maximum or min- 
imum value Is assigned. 

[0036] The code vector generating means may assign an intermediate value to predetermined units of data in 
accordance with the arrangement state of the units of data to which the minimum value is assigned. 
45 [0037] According to stHI another aspect of the present invention, the apparatus is characterized by comprising 
means for combining code books made by at least two of the above-described code vector generating means to make 
one code book. 

[0038] A computer-readable recording medium of the present invention is characterized by storing a program for 
causing a computer to execute at least one of the above-described various code book making procedures. 
so [0039] Still another aspect of the present invention is characterized by storing a code book made by the above- 
described various code book making procedures. 

[0040] In the present invention, as described above, with reference to one or more units of data in the data string 
constituting the vector, a code vector is generated by giving a value which increases in an increment of a predetermined 
value from the reference data value to each unit of the other data in the data string. Hence, a greatly versatile code book 
55 can easily be made at least for data on a pattern, for example, data of a face image, whose data value gradually varies 
by a small change. In addition, since individual code vectors constituting the code book are generated in accordance 
with predetermined arithmetic operation, which kinds of patterns are included in the made code book can easily be rec- 
ognized. 
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[0041] According to another characteristic feature of the present invention, one code vector is generated by classi- 
fying the data string constituting the vector into data groups, dividing the total range of possible values of the respective 
units of data in the data string by the number of classified data groups, and selectively assigning, as each data value in 
each data group, an arbitrary value in the divided range corresponding to the data group. Hence, a greatly versatile 
5 code book can easily be made at least for data on a pattern, for example, data of a landscape image, whose data value 
gradually varies by a relatively large change. In addition, which kinds of patterns are included in the made code book 
can easily be recognized. 

[0042] According to still another characteristic feature of the present invention, one code vector is generated by, in 
the data string constituting the vector, setting the ratio of the maximum value or minimum value of possible values of the 

10 respective units of data in the data string, assigning the maximum value or minimum value to arbitrary units of data con- 
stituting the data string in accordance with the set ratio, and simultaneously assigning the minimum value or maximum 
value to each unit of data other than the units of data assigned the maximum value or minimum value. Hence, a greatly 
versatile code book can easily be made at least for data on a pattern, for example, data of a character image, whose 
data value abruptly varies. In addition, which kinds of patterns are included in the made code book can easily be rec- 

15 ognized. 

[0043] According to still another characteristic feature of the present invention, since code books made by at least 
two methods of the above-described code book making methods are combined to make one code book, a more versa- 
tile code book can easily be made. 

[0044] As described above, according to the present invention, by giving a desired value to code vector data, a 
20 greatly versatile code book capable of coping with various data including data which monotonically varies or data which 
abruptly varies can be realized. When the code book made by the present invention is used, a greatly versatile system 
for data compression/decompression, which can reconstruct, for various images, high-quality images even at a high 
compression ratio, can be implemented. 

[0045] An apparatus for making a code book used in vector quantization according to still another aspect of the 

25 present invention is an apparatus for making a code book used in vector quantization, said code book comprising a set 
of vectors each of which is a data string including at least one unit of data, characterized by comprising: solid pattern 
generating means for generating at least one type of solid pattern code whose data value gradually varies in a block 
constituting the vector; and edge pattern generating means for generating at least one type of edge pattern code whose 
data value abruptly varies in the block. 

30 [0046] According to still another aspect of the present invention, the apparatus is characterized by comprising stor- 
age means for storing the pattern codes generated by the solid pattern generating means and the edge pattern gener- 
ating means, and code calculating means for, in executing the vector quantization, performing arithmetic operation for 
the pattern codes stored in. the storage means to generate pattern codes different from the pattern codes. 
[0047] A method of making a code book used in vector quantization according to still another aspect of the present 

35 invention is a method of making a code book used in vector quantization, said code book comprising a set of vectors 
each of which is a data string including at least one unit of data, characterized in that: at least one type of solid pattern 
code whose data value gradually varies in a block constituting a vector and at least one type of edge pattern code 
whose data value abruptly varies in the block, are generated as basic patterns and stored in storage means; and in exe- 
cuting the vector quantization, pattern codes different from the basic patterns are generated by performing arithmetic 

40 operation for the pattern codes stored in the storage means. 

[0048] Still another aspect of the present invention is directed to a method of making a code book used in vector 
quantization. The code book comprising a set of vectors each of which is a data string including at least one unit of data. 
The method is characterized in that at least one type of solid pattern code is generated in advance as a basic pattern 
and stored in storage means; and, in executing the vector quantization, a pattern code different from the basic pattern 

45 is generated by performing arithmetic operation for the at least one type of pattern code which is stored in the storage 
means. 

[0049] A vector quantizing device of the present invention is a vector quantizing device which forms, as a vector, a 
block from a data string including at least one unit of data, searches for a code vector similar to the vector extracted from 
a compression target from a code book prepared in advance, and outputs a code corresponding to the code vector, 

so characterized by comprising: solid pattern generating means for generating at least one type of solid pattern code 
whose data value gradually varies in the block; edge pattern generating means for generating at least one type of edge 
pattern code whose data value abruptly varies in the block; storage means for storing the pattern codes generated by 
said solid pattern generating means and said edge pattern generating means; code calculating means for, in executing 
the vector quantization, performing arithmetic operation for the pattern codes stored in said storage means to generate 

55 pattern codes different from the pattern codes; and vector quantizing means for executing the vector quantization using 
the pattern codes read out from said storage means and the pattern codes generated by said code calculating means. 
[0050] According to still another aspect of the present invention, a vector quantizing device which forms, as a vec- 
tor, a block from a data string including at least one unit of data, searches for a code vector similar to the vector 
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extracted from a compression target from a code book prepared in advance, and outputs a code corresponding to the 
code vector, is characterized by comprising: storage means for storing the code book; caiculating means for, in execut- 
ing the vector quantization, performing arithmetic operation for codes stored in said storage means to generate codes 
different from the stored codes; and vector quantizing means for executing the vector quantization using the codes read 

5 out from said storage means and the codes generated by said calculating means. 

[0051 ] A computer-readable recording medium of the present invention is characterized by recording a program for 
causing a computer to execute the processing procedure of the code book making method according to claim 32 or 33. 
[0052] According to still another aspect of the present invention, a recording medium which records a vector quan- 
tization program for forming, as a vector, a block from a data string including at least one unit of data, searching for a 

10 code vector similar to the vector extracted from a compression target from a code book prepared in advance, and out- 
putting a code corresponding to the code vector, is characterized in that said computer-readable recording medium 
records a program for causing a computer to execute: the calculating step of, in executing the vector quantization, per- 
forming arithmetic operation for codes stored in storage means to generate codes different from the stored codes; and 
the vector quantizing step of executing the vector quantization using the codes read out from the storage means and 

15 the codes generated in the calculating step. 

[0053] According to the present invention, as described above, a solid pattern code whose data value gradually var- 
ies in a block and an edge pattern code whose data value abruptly varies in a block are generated as basic patterns, 
thereby making it possible to cope with various images constructed by combinations of the code vector and edge pat- 
tern. 

20 [0054] In addition, according to another characteristic feature of the present invention, the basic patterns are gen- 
erated and stored in advance, and, in executing vector quantization, arithmetic operation is performed for the pattern 
codes stored to generate pattern codes different from the basic patterns. Hence, various pattern codes are generated 
by arithmetic operation in executing vector quantization, a pattern code closer to the original image can be applied, and 
the quality of the reconstructed image can be improved. Since only the basic patterns need be stored in the storage 

25 means, the memory capacity can be suppressed. 

[0055] As described above, according to the present invention, a greatly versatile code book capable of coping with 
various images can be realized without increasing the memory capacity for storing it 

[0056] A device for data compression of the present invention is a device for data compression, which forms, as a 
vector, a block from a data string including at least one unit of data, searches for a code vector similar to the vector 

30 extracted from a compression target from a code book prepared in advance, and outputs a code corresponding to the 
code vector, is characterized by comprising: code book storage means for storing a code book prepared for every dif- 
ferent type of pattern; discriminating means for discriminating a type of pattern of data of the block on the basis of infor- 
mation in the block of the compression target; and vector quantizing means for executing vector quantization processing 
using the code books prepared for the respective patterns in accordance with a discrimination result by said discrimi- 

35 nating means. 

[0057] The discriminating means discriminates, for example, on the basis of data values of elements in the block of 
the compression target, between a first pattern whose data value gradually varies in a certain direction in the block and 
a second pattern whose data value abruptly varies in the block. 

[0058] For example, when the difference between the maximum and minimum values of the elements in the block 
40 is smaller than a predetermined threshold value, the block is discriminated as the first pattern, and when the difference 
between the maximum and minimum values in the block is larger than the predetermined threshold value, the block is 
discriminated as the second pattern. 

[0059] The vector quantizing means may obtain similarity for the blocks of the patterns of different types by different 
processes. 

45 [0060] In this case, for the first pattern in which the data value of each element in the block of the compression tar- 
get gradually varies, the vector quantizing means obtains the similarity using only data values of elements at four cor- 
ners in a rectangular block. 

[0061] In addition, a direction of data value change in the block may be detected from the data values at the four 
corners in the block, and the similar code vector may be searched for in consideration of the direction. 
so [0062] In executing vector quantization using the pieces of information at the four corners, each code vector consti- 
tuting the code book for the first pattern may be formed from only pieces of information on the elements at the four cor- 
ners in the block. 

[0063] A device for data decompression of the present invention is a device for data decompression which uses a 
data string including at least one unit of data as a vector, searches for a code vector corresponding to a compression 
55 code from a code book including at least one code vector, and assigns the code vector to a corresponding block position 
to reconstruct original data, is characterized by comprising: code book storage means for storing a code book prepared 
for every different type of pattern; and decoding means for, on the basis of compression codes generated on the com- 
pressing side for the respective patterns of different types, searching for code vectors corresponding to the compres- 
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sion codes from the code books prepared for the respective patterns. 

[0064] The different types of patterns include a first pattern in which the data value of each element in the block of 
the compression target gradually varies in a certain direction in the block and a second pattern in which the data value 
abruptly varies in the block. 

5 [0065] Each code vector constituting the code book for the first pattern may be formed from only pieces of informa- 
tion on the elements at the four corners in the rectangular block. 

[0066] |n this case, the device may comprise calculating means for calculating, by arithmetic operation, pieces of 
information on other elements on the basis of the pieces of information on the elements at the four corners in the block. 
[0067] A method for data compression of the present invention is a method for data compression in which a block 

10 is formed, as a vector, from a data string including at least one unit of data, a code vector similar to the vector extracted 
from a compression target is searched from a code book prepared in advance, and a code corresponding to the code 
vector is output, characterized in that: a type of pattern of data in the block of the compression target is discriminated 
on the basis of information in the block and vector quantization processing is executed using code books prepared for 
the respective patterns in accordance with a discrimination result 

75 [0068] According to still another aspect of the present invention, in executing the vector quantization processing, for 
the blocks of the patterns of different types, similarities of vectors may be obtained by different processes, and for the 
first pattern, the similarity may be obtained using only data values of elements at four corners in a rectangular block. 
[0069] In addition, a direction of data value change in the block may be detected from the data values at the four 
corners in the block, and the similar code vector may be searched for in consideration of the direction. 

20 [0070] A method for data compression of the present invention is a method for data decompression in which a data 
string including at least one unit of data is used as a vector, a code vector corresponding to a compression code is 
searched from a code book including at least one code vector, and the code vector is assigned to a corresponding block 
position to reconstruct original data, characterized in that: on the basis of compression codes generated on the com- 
pressing side for the respective different types of patterns, code vectors corresponding to the compression codes are 

25 searched from code books prepared for the respective patterns. 

[0071] According to still another aspect of the present invention, each code vector constituting the code book for 
the first pattern may have only pieces of information on the elements at the four corners in a rectangular block, and in 
searching for the code vector corresponding to the compression code and assigning the code vector to the correspond- 
ing block position, pieces of information on other elements may be calculated by arithmetic operation on the basis of 

30 the pieces of information on the elements at the four corners in the block. 

[0072] A system for data compression/decompression of the present invention is a system for data compres- 
sion/decompression including a device for data compression which forms, as a vector, a block from a data string includ- 
ing at least one unit of data, searches for a code vector similar to the vector extracted from a compression target from 
a code book prepared in advance, and outputs a code corresponding to the code vector, and a device for data decom- 

35 pression which searches for a code vector corresponding to the code from the code book and assigns the code vector 
to a corresponding block position to reconstruct original data, characterized in that said device for data compression 
comprises first code book storage means for storing a code book prepared for every different type of pattern, discrimi- 
nating means for discriminating a type of pattern of data of the block on the basis of information in the block of the com- 
pression target, and vector quantizing means for executing vector quantization processing using the code books 

40 prepared for the respective patterns in accordance with a discrimination result by said discriminating means; and said 
device for data decompression comprises second code book storage means for storing a code book prepared for every 
different type of pattern, and decoding means for, on the basis of compression codes generated on the compressing 
side for the respective patterns of different types, searching for code vectors corresponding to the compression codes 
from the code books prepared for the respective patterns. 

45 [0073] Each of the first and second code book storage means may store the code books of the patterns of different 
types in a single storage device. 

[0074] Alternatively, each of the first and second code book storage means may separately store the code books 
of the patterns of different types in storage devices, and information for identifying a pattern may be supplied to the 
device for data decompression together with the code generated by the device for data compression. 
so [0075] A computer-readable recording medium of the present invention is characterized by recording a program for 
causing a computer to function as each of the above-described means or a program for causing a computer to realize 
the above-described functions. 

[0076] Still another aspect of the present invention is characterized by recording a program for causing a computer 
to execute the processing procedure of the above-described method for data compression or method for data decbm- 
55 pression. 

[0077] In the present invention, as described above, in executing vector quantization, patterns are discriminated on 
the basis of information in a block extracted from a compression target, and vector quantization is executed using 
appropriate code books prepared for the respective patterns. Hence, for example, when an image is compressed, and 
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the image is reconstructed using a selected code vector, a more natural reconstructed Image according to the human 
visual characteristic can be obtained. 

[0078] According to still another aspect of the present invention, for a solid pattern, similarity is calculated using 
only information at the four corners in the block, and simultaneously, the direction of change in the block is detected, 
5 and a code vector is selected on the basis of the result. Hence, a disadvantage that an unnatural code vector whose 
data value in the block varies in a direction opposite to that of the change in the entire image is selected can be properly 
prevented, and a reconstructed image having a higher quality can be obtained. 

Brief Description of the Drawings 

10 

[0079] 

Fig. 1 is a function block diagram showing the construction of an apparatus for making a code book for a face image 
according to the first embodiment; 
15 Fig. 2 is a flow chart showing the operation of the apparatus for making a code book for a face image according to 
the first embodiment; 

Fig. 3 shows conceptional views for explaining a method of making the code book for a face image according to the 
first embodiment, in which (a) is a view showing a pattern, and (b) is a view showing a state wherein the luminance 
value changes by 20 per pixel; 

20 Fig; 4 is a graph showing the comparison result of PSNR characteristic between a code book made In the first 
embodiment and a code book individually optimized by the Kohonen serf-organizing map method; 
Fig. 5 is a function block diagram showing the construction of an apparatus for making a code book for a landscape 
image according to the second embodiment; 

Fig. 6 is a flow chart showing the operation of the apparatus for making a code book for a landscape image accord- 

25 ing to the second embodiment; 

Fig. 7 shows conceptional views for explaining a method of making the code book for a landscape image according 
to the second embodiment, in which (a) is a view showing a pattern whose luminance value gradually increases 
from the upper left corner of the block to the lower right corner, and (b) is a view showing a state wherein the 
dynamic range of luminance values of 0 to 255 are divisionally defined in five ranges in accordance with five 

30 regions A to E; 

Fig. 8 is a function block diagram showing the construction of an apparatus for making a code book for a character 
image according to the third embodiment; 

Fig. 9 is a flow chart showing the operation of the apparatus for making a code book for a character image accord- 
ing to the third embodiment; 

35 Fig. 1 0 shows conceptional views for explaining a method of making the code book for a character image according 
to the third embodiment, in which is a view showing the first pattern, (b) is a view showing the second pattern, (c) 
is a view showing the third pattern, and (d) is a view showing the fourth pattern; 

Fig. 1 1 is a graph showing the comparison result of PSNR characteristic between a code book made in the fourth 
embodiment and a code book individually optimized by the Kohonen self-organizing map method; 
40 Fig. 1 2 is a block diagram showing the construction of an apparatus for making a code book for a character image 
according to the fifth embodiment; 

Fig. 1 3 is a block diagram showing the construction of a vector quantizing device according to the fifth embodiment; 
Fig. 14 shows illustrations of examples of solid patterns to be generated, in which (a) is an illustration showing a 
pattern whose luminance value gradually increases in the order ofA-»B-»C-»D from the left side to the right 

45 side of the block in units of vertical lines, (b) is an illustration- showing a pattern whose luminance value gradually 
increases from the right side to the left side of the block in units of vertical lines, (c) is an illustration showing a pat- 
tern whose luminance value gradually increases from the lower side to the upper side of the block in units of hori- 
zontal lines, (d) is an illustration showing a pattern whose luminance value gradually increases from the upper side 
to the lower side of the block in units of horizontal lines, (e) is an illustration showing a pattern whose luminance 

so value gradually increases from the upper left corner to the lower right corner of the block in units of oblique lines, 
(f) is an illustration showing a pattern whose luminance value gradually increases from the upper right comer to the 
lower left corner of the block in units of oblique lines, (g) is an illustration showing a pattern whose luminance value 
gradually increases from the lower left corner to the upper right corner of the block in units of oblique lines, and <h) 
is an illustration showing a pattern whose luminance value gradually increases from the lower right corner to the 

55 upper left corner of the block in units of oblique lines; 

Fig. 1 5 is an illustration showing examples of codes of basic patterns of edges to be generated; 
Fig. 1 6 is a flow chart showing the procedure of generating a basic solid pattern; 
Fig. 1 7 is a flow chart showing the procedure of generating a basic edge pattern; 
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Rg. 1 8 is a flow chart showing the procedure of executing vector quantization; 

Fig. 1 9 is a block diagram showing a construction of a system for data compression/decompression according to 
the sixth embodiment; 

Rg. 20 is an illustration for explaining the operation principle of vector quantization according to the sixth embodl- 
5 ment; 

Rg. 21 shows illustrations of examples of code vectors (pattern images) constituting a code book, in which (a) is 
an illustration showing a case wherein code vectors of patterns which monotonically change in eight directions are 
registered, and (b) is an illustration showing a case wherein code vectors whose luminance values abruptly change 
are registered; 

to Rg. 22 is a flow chart showing an example of data compressing operation; 

Rg. 23 is a flow chart showing an example of data decompressing operation; 

Rg. 24 is a block diagram showing another construction of the system for data compression/decompression; 
Rg. 25 is a flow chart showing another example of data compressing operation; 
Rg. 26 is a flow chart showing another example of data decompressing operation; 
is Rg. 27 is an illustration for explaining the seventh embodiment; 

Rg. 28 is a block diagram showing the construction of a conventional vector quantizing device; and 
Rg. 29 shows illustrations for explaining conventional problems, in which (a) and (b) are illustrations showing parts 
of a reconstructed image reconstructed by embedding code vectors (pattern images of blocks) obtained by vector 
quantization in units of blocks. 

20 

Detailed Description of the Preferred Embodiments 

[0080] An embodiment of the present invention will be described below with reference to drawings. 
25 (First Embodiment) 

[0081] In the first embodiment, an apparatus and method for making a code book for, e.g., a face image will be 
described. Rg. 1 is a function block diagram showing the construction of the apparatus for making the code book 
according to this embodiment. 

30 [0082] Rg. 2 is a flow chart showing the operation of the apparatus for making the code book according to this 
embodiment. Fig. 3 shows conceptional views for explaining the method of making the code book according to this 
embodiment. 

[0083] Generally, most parts of a face image are occupied by patterns whose pixel values smoothly change as a 
whole. The change is monotonic and very little. In this embodiment, as typical code patterns of a face image code book, 

35 patterns which monotonically change in eight directions are generated, as shown in Fig. 3. 

[0084] More specifically, a set of pixel values, which is formed from, e^g., a block of 4 pixels x 4 pixels is defined as 
one vector (to be referred to as a code vector hereinafter) in a code book, and a pattern whose pixel value (e.g., lumi- 
nance value) in the block gradually changes from one of the edge portions (upper, lower, left, and right sides and four 
corner points) of the block is generated. In this case, a 4 x 4 pixel code vector is generated as an example. However, 

40 the present invention is not limited to this size. 

[0085] Referring to Rg. 3(a), pattern (J) is a pattern whose luminance value gradually increases, as A B -» C 
D, from the left side to the right side of the block in units of vertical lines. As the degree of change, for example, the lumi- 
nance value changes by 20 per pixel, as shown in Rg. 3(b). More specifically, letting K be the luminance value at the 
left end in the block, the luminance values at the second line, third line, and right end are K + 20, K + 40, and K + 60, 

45 respectively. 

[0086] In this embodiment, 20 is defined as the maximum value of the degree of change in luminance value, and a 
pattern is generated while changing the degree to various values such as 10, 5, 2, and 1 . For the luminance value K of 
the pixel at the start point of change, the minimum and maximum values of possible values are given, and values appro- 
priately dispersed therebetween are given. This generates variations in pattern whose luminance value gradually 
so changes from the left side to the right side in the block, like pattern ©. The step width of the luminance value which 
gradually changes is not limited to the above-described examples. 

[0087] This also applies to the remaining patterns ® to ®, though only pattern © shown in Rg. 3(a) has been 
described above in detail. Pattern @ is a pattern whose luminance value gradually increases from the right side to the 
left side of the block in units of vertical lines, pattern ® is a pattern whose luminance value gradually increases from 
55 the lower side to the upper side of the block in units of horizontal lines, and pattern @ is a pattern whose luminance 
value gradually increases from the upper side to the lower side of the block in units of horizontal lines. 
[0088] Pattern © is a pattern whose luminance value gradually increases from the upper left corner to the lower 
right comer of the block in units of oblique lines, pattern ® is a pattern whose luminance value gradually increases 
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from the upper right corner to the lower left corner of the block in units of oblique lines, pattern @ is a pattern whose 
luminance value gradually increases from the lower left corner to the upper right corner of the block in units of oblique 
lines, and pattern ® is a pattern whose luminance value gradually increases from the lower right corner to the upper 
left corner of the block in units of oblique lines. In these patterns © to ®, the luminance value gradually changes in 
5 seven steps. 

[0089] The function/construction and operation of the apparatus for generating code vectors as shown in Fig. 3 will 
be described next with reference to the block diagram shown in Fig. 1 and the flow chart shown in Fig. 2. 
[0090] Referring to Fig. 2, first in step S1, for example, a 4 x 4 pixel block is classified into several groups (the 
number of groups is N). For example, to generate the code vector of pattern © shown in Fig. 3(a), the block is divided 

10 into four groups A to D in units of vertical lines. 

[0091] In performing this grouping, first, a start point in the block is set using a start point setting section 1 shown 
in Fig. 1. For example, to generate pattern © shown in Fig. 3(a), the four pixels (group A) at the left side in the block 
are set as a start point Note that the start point setting section 1 can be constructed by an input device such as a key- 
board or a mouse to cause the user to set an arbitrary start point. Alternatively, the apparatus itself may automatically 

is set the start point in order sequentially to generate the eight patterns © to ® shown in Fig. 3(a). 

[0092] A grouping section 2 performs grouping in accordance with the start point set by the start point setting sec- 
tion 1. For example, to generate pattern © or @ shown in Fig. 3(a), grouping is performed in units of lines in the ver- 
tical direction, or to generate pattern @ or @, grouping is performed in units of lines in the horizontal direction. To 
generate patterns © to ®, grouping is performed in units of lines in the oblique directions. 

20 [0093] Next in step S2, the increment (step) of the luminance value between adjacent groups is set using an incre- 
ment setting section 3 shown in Fig. 1 . The increment setting section 3 can also be constructed by an input device such 
as a keyboard or a mouse to cause the user to set an arbitrary increment, or the apparatus itself may automatically set 
a predetermined default value. In step S2, processing of initializing a count value i for counting the number of processed 
groups to 0 is also performed. 

25 [0094] In step S3, a start point luminance value setting section 4 shown in Fig. 1 sets the luminance value at the 
start point in the block. To give the luminance vaiue at the start point, for example, the range of 

0 to (maximum luminance value (= 255) - (N - 1) x step) 

30 is equally divided into n parts, and each equally divided value is set as the luminance value at the start point. Although 
the equally divided value is given here, it need not always be the equally divided value as far as it fails within the range 
of 0 to (255 - (N - 1) x step). In addition, although luminance values are given here by arithmetic operation, the user may 
arbitrarily input the luminance value at the start point within the above range by his/her discretion. 
[0095] When necessary pieces of information including the luminance value at the start point and the increment of 

35 luminance, are set, these pieces of information are supplied to a code book making section 5 shown in Fig. 1 . The code 
book making section 5 executes processing from step S4 shown in Fig. 2, thereby generating one code vector. More 
specifically, as the luminance value as the start point in one code vector is set in processing until step S3, processing 
shifts to the group adjacent to the start point and the count value i is incremented by one in step S4. 
[0096] In step S5, it is determined whether the count value i is smaller than the value of group count N. If YES in 

40 step S5, an unprocessed group remains, and therefore the flow advances to step S6 to give a luminance value calcu- 
lated by (the luminance value of the group at the start point + i x step) to the current group. The count value i is incre- 
mented by one, and the flow returns to step S5. This processing is repeated until no unprocessed group remains. 
[0097] When luminance values are given to all groups, the code vector of the pattern whose luminance value grad- 
ually increases from the start point to the end point in units of groups is generated. In this case, the flow advances to 

45 step S7 to store the code vector generated at this time in a code book data memory 6 shown in Fig. 1 . 

[0098] As described above, when one cycle of processing shown in the flow chart of Fig. 2 is ended, one code vec- 
tor is generated and stored in the code book data memory 6. When such processing is executed two or more times 
while changing the start point position, the luminance value at the start point, and the value of increment in the block in 
various ways, code vectors having different luminance values are generated for the eight patterns © to ® shown in 

so Fig. 3(a). The set of the code vectors is a code book for a face image. The code book size is, e.g., 512. 

[0099] Fig. 4 is a graph showing the PSNR (Peak Signal to Noise Ratio) characteristics of images which are 
obtained when vector quantization (VQ) is executed for five face images using the code book having a size of 512, 
which is made by the method of this embodiment, and then, the images are reconstructed using the same code book 
as that used for VQ. Fig. 4 also shows, as a reference, the PSNR characteristics of the images, which are obtained 

55 when the code book is individually optimized using the images by the Kohonen self-organizing map method, VQ 
processing is executed for each image using a corresponding code book, and then each image is reconstructed using 
the same code book as that used for VQ. 

[0100] As is apparent from the. result shown in Fig. 4, the PSNR characteristic obtained in use of one code book 
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made by the method of this embodiment is equivalent to that obtained in use of the five code books made by the 
Kohonen algorithm. As described above, according to this embodiment, even one code book can provide almost the 
same PSNR characteristic as that obtained when optimum code books are made by the Kohonen algorithm for the 
respective face images, so a greatly versatile code book can be made. 
5 [0101] As described above, according to the first embodiment, a greatly versatile code book compatible to various 
face images with only one code book can be obtained. Additionally, in this embodiment, since each code vector is gen- 
erated in accordance with a predetermined arithmetic operation pattern, which pattern is included in the optimized code 
book can easily be recognized. 

[0102] In the above embodiment, a pattern whose luminance value gradually increases from the start point to the 
10 end point in a block is generated. Conversely, a pattern whose luminance value gradually decreases may be generated. 
[0103] In this embodiment, the maximum value of the degree of change is 20. However, 20 need not always be 
used, and an arbitrary value such as 40 or 1 0 is appropriately given. The code book size need not always be 512, either. 

(Second Embodiment) 

15 

[0104] In the second embodiment, an apparatus and method for making a code book for, e.g., a landscape image 
will be described. Fig. 5 is a function block diagram showing the construction of the apparatus for making the code book 
according to this embodiment. Fig. 6 is a flow chart showing the operation of the apparatus for making the code book 
according to this embodiment. Fig. 7 shows conceptions views for explaining the method of making the code book for 

20 a landscape image according to this embodiment 
. [0105] When a landscape image was checked, many patterns had pixel values monotonically changed, like the typ- 
ical patterns of a face image, and they included many patterns whose degree of change was very large. In this embod- 
iment, the code vector of a pattern whose luminance, value gradually changes in a block and which uses almost the 
entire dynamic range of luminance values is generated. 

25 [0106] More specifically, using a pattern in which the start point is set at one of the four corners of a block while the 
end point is set on the diagonal side, and the luminance value gradually changes, a block is divisionally defined in, e.g., 
five regions. On the other hand, the dynamic range of luminance values of 256 levels is divisionally defined in five 
ranges. By appropriately giving the luminance values in the regions of the block within corresponding level ranges, pat- 
terns for a landscape image are generated. In this embodiment, as such patterns for a landscape image, patterns 

30 whose luminance values gradually change in four directions starting from the four corners of the block are generated. 
[0107] Fig. 7(a) shows a pattern whose luminance value gradually increases from the upper left corner to the lower 
right corner of the block. As shown in Fig. 7(a), a block formed from 4 pixels x 4 pixels is obliquely segmented into five 
regions A to E. On the other hand, as shown in Fig. 7(b), the dynamic range of luminance values from 0 to 255 is divi- 
sionally defined in five ranges corresponding to the five regions A to E, respectively. 

35 [0108] In this example, luminance values of 0 to 63 are defined for the region A, luminance values of 63 to 95 are 
defined for the region B, luminance values of 95 to 159 are defined for the region C, luminance values 159 to 191 are 
defined for the region D, and luminance values of 191 to 255 are defined for the region E. As the luminance value of 
each of the regions A to E in the block, a value belonging to the level range assigned to each region is appropriately 
selected and given, thereby generating a pattern for a landscape image. 

40 [0109] The function/construction and operation of the apparatus for generating the code vector as shown in Rg. 7 
will be described next with reference to the block diagram shown in Fig. 5 and the flow chart shown in Rg. 6. 
[0110] Referring to Fig. 6, first in step S11, for example, a 4 x 4 pixel block is classified into several groups (the 
number of groups is N). For example, to generate the code vector of the pattern shown in Fig. 7(a), pixels in the block 
are divided into five groups A to E. 

45 [0111] In performing this grouping, first, a start point in the block is set using a start point setting section 1 1 shown 
in Rg. 5. For example, to generate the pattern shown in Fig. 7(a), three pixels at the upper left corner in the block are 
set as a start point Note that the start point setting section 1 1 can be constructed by an input device such as a keyboard 
or a mouse to cause the user to set an arbitrary start point. Alternatively, the apparatus may automatically set the start 
point in order sequentially to generate patterns changing in four directions. A grouping section 12 performs grouping in 

so accordance with the start point set by the start point setting section 11. 

[0112] In step S12, the dynamic range of luminance values is divided into N parts (S 0 , S 1f ..., S N ..,) using a dynamic 
range dividing section 13 shown in Fig. 5 in accordance with the N regions after grouping. In step S12, processing of 
initializing a count value i for counting the number of processed groups to 0 is also performed. When grouping of a block 
and division of the dynamic range are performed, these pieces of information are supplied to a code book making sec- 

55 tion 14 shown in Rg. 1 . 

[0113] The code book making section 14 executes processing from step S13 shown in Rg. 6, thereby generating 
one code vector. More specifically, in step S13, for the group as the start point (group A in the example shown in Fig. 
7), a luminance value belonging to the luminance level range S 0 corresponding to the group is set. In step S1 4, process- 
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ing shifts to the group (group B in the example shown in Fig. 7) adjacent to the start point and the count vaiue i is incre- 
mented by one. 

[0114] In step S15, it is determined whether the count value i is smaller than the value of group count N. If YES in 
step S1 5, an unprocessed group remains, and therefore the flow advances to step S1 6 to set, for the current group, a 
luminance value belonging to the luminance level range St corresponding to the group. The count value i is incre- 
mented by one, and the flow returns to step S15. This processing is repeated until no unprocessed group remains. 
[0115] When luminance values are given to ail groups, the code vector of the pattern whose luminance value grad- 
ually increases from the start point to the end point in units of groups is generated. In this case, the flow advances to 
step S17 to store the code vector generated at this time in a code book data memory 15 shown in Fig. 5. 
[0116] As described above, when one cycle of processing shown in the flow chart of Fig. 6 is ended, one code vec- 
tor is generated and stored in the code book data memory 15. When such processing is executed two or more times 
while changing the luminance value at the start point position in the block and the luminance value to be given to pixels 
in each region in various ways, code vectors having different luminance values are generated as the code vectors of 
patterns which change in four directions. The set of the code vectors is a code book for a landscape image. 
[0117] Although not illustrated here, when the code book made in this embodiment was applied to landscape 
images of several types, as In the first embodiment, a PSNR characteristic almost the same as that of a code book opti- 
mally made by the Kohonen algorithm for each landscape image was obtained, and a relatively satisfactory PSNR char- 
acteristic was obtained. 

[0118] As described above, according to the second embodiment, a greatly versatile code book compatible to var- 
ious landscape images with only one code book can be obtained. Additionally, in this embodiment, since each code 
vector is generated in accordance with a predetermined pattern, which pattern is included in the optimized code book 
can easily be recognized. 

[0119] In the above embodiment, a pattern whose luminance value gradually increases from the start point to the 
end point in a block is generated. Conversely, a pattern whose luminance value gradually decreases may be generated. 
[0120] In this embodiment, the region in the block is divided into five regions. However, the code vector is divided 
into five regions only as an example, and the number of regions need not always be five. 

(Third Embodiment) 

[0121] In the third embodiment, an apparatus and method for making a code book for, e.g., an image including a 
character will be described. Fig. 8 is a function block diagram showing the construction of the apparatus for making the 
code book according to this embodiment. Rg. 9 is a flow chart showing the operation of the apparatus for making the 
code book according to this embodiment. Fig. 10 shows conceptional views for explaining the method of making the 
code book for a character image according to this embodiment. 

[0122] When an image including a character was checked, most patterns had large changes. In addition, most pat- 
terns fully used the dynamic range of luminance values of 256 levels. In this embodiment, the vectors of four typical pat- 
terns as shown in Rg. 1 0 are generated as code vectors for a character image. 

[0123] The first patterns are patterns each obtained by appropriately embedding one of black patterns of seven 
types (patterns of minimum luminance values) of 1 x 1 , 1 x 2, 1 x 3, 1 x 4, 2 x 2, 2 x 3, and 2 x 4 in a background white 
pattern (pattern of maximum luminance value) of 4 pixels x 4 pixels, as shown in Fig. 10(a). The second patterns are 
patterns each obtained by obliquely embedding black dots in a block, as shown in Rg. 10(b). 

[0124] The third pattern is a pattern obtained by embedding black dots in a cross, as shown in Fig. 1 0(c). The forth 
patterns are patterns each obtained by embedding a line of black dots while bending it midway, as shown in Fig. 10(d). 
In these patterns, a pixel value adjacent to a black dot is set to an intermediate value in accordance with whether the 
black dots linearly occupy the block. 

[0125] The function/construction and operation of the apparatus for generating code vectors as shown in Fig. 10 
will be described next with reference to the block diagram shown in Rg. 8 and the flow chart shown in Rg. 9. 
[0126] Referring to Rg. 9, first, in step S21 , the ratio of pixels of black dots (minimum luminance value) in, e.g., a 4 
x 4 pixel block is determined. 

[0127] The black dot ratio in the block is performed by a minimum luminance ratio setting section 21 shown in Rg. 
8. Note that the minimum luminance ratio setting section 21 can be constructed by an input device such as a keyboard 
or a mouse to cause the user to set an arbitrary ratio. Alternatively, the apparatus may automatically set the ratio in 
order sequentially to generate various patterns. 

[0128] In step S22, black dots (minimum luminance value) are given to predetermined pixel positions in the block 
and white dots (maximum luminance value) are given to the other pixel positions using a maximum/minimum luminance 
value setting section 22 shown in Rg. 8 in accordance with the set black dot ratio. In step S23, it is determined whether 
the black dots linearly occupy the block. If NO in step S23, the code vector generated in processing until step S22 is 
stored in a code book data memory 24 shown in Rg. 8. 
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[0129] If YES in step S23, the flow advances to step S24 to change the luminance value of the pixel of a white dot 
adjacent to the pixel of a black dot to the halftone luminance value. The code vector generated in this way is stored in 
the code book data memory 24 shown in Rg. 8. 

[0130] As described above, when one cycle of processing shown In the flow chart of Fig. 9 is ended, one code vec- 
5 tor is generated and stored in the code book data memory 24. When such processing is executed two or more times 
while changing the black dot ratio in the block and the position to which the black dot is given in various ways, code vec- 
tors of various patterns are generated. The set of the code vectors Is a code book for a character image. 
[0131] Although not illustrated here, when the code book made in this embodiment was applied to character 
images of several types, as in the first embodiment, a PSNR characteristic almost the same as that of a code book opti- 
w mally made by the Kohonen algorithm for each landscape image was obtained, and a relatively satisfactory PSNR char- 
acteristic was obtained. 

[0132] As described above, according to the third embodiment, a greatly versatile code book compatible to various 
character images with only one code book can be obtained. Additionally, in this embodiment, since each code vector is 
generated in accordance with a predetermined rule, which pattern is included in the made code book can easily be rec- 



[0133] In the above embodiment, seven types of patterns 1 x 1 , 1 x 2, 1 x 3, 1 x 4, 2 x 2, 2 x 3, and 2 x 4 are used 
as the black dot pattern in the block. However, the number of types need not always be seven. 

(Fourth Embodiment) 



[0134] In the fourth embodiment, the code books made by the methods described in the first to third embodiments 
are combined into one code book having a size of 1,024. 

[0135] Rg. 1 1 is a graph showing the PSNR characteristics of images, which are obtained when vector quantization 
(VQ) processing is performed for images A to S of 19 types, including face images, landscape images, and character 

25 images, using the code book having a size of 1,024 according to this embodiment and then, each image is recon- 
structed using the same code book as that used for VQ. Fig. 1 1 also shows, as a reference, the PSNR characteristics 
of the images, which are obtained when the code book is individually optimized using the images by the Kohonen self- 
organizing map method, VQ processing is executed for each image using a corresponding code book, and then each 
image is reconstructed using the same code book as that used for VQ. 

30 [0136] As is apparent from the result shown in Fig. 1 1 , the PSNR characteristic obtained in use of one code book 
made by the method of this embodiment is equivalent to that obtained in use of the 19 code books made by the 
Kohonen algorithm. As described above, according to this embodiment, even one code book can provide almost the 
same PSNR characteristic as that obtained when optimum code books are made by the Kohonen algorithm for the 
respective images, and high-quality images can be reconstructed for various images including an image which monot- 

35 onicalty changes or an image which abruptly changes, so a greatly versatile code book can be made. 

[0137] In this embodiment, the size of the code book is set to 1 ,024. However, the size need not always be 1 ,024 
and can be appropriately determined to, e.g., 128 or 512 in accordance with the application purpose. In addition, 
although code books of three types are combined into one code book, code books of appropriate two types may be 
combined into one code book. 

40 [0138] In the above-described first to fourth embodiments, a code vector of 4 pixels x 4 pixels is generated. How- 
ever, the code vector need not always have 4 pixels x 4 pixels, and the target of vector quantization need not always be 
image data. 

[0139] The above-described code book making apparatus of this embodiment is constructed by a microcomputer 
system having a CPU, a ROM, and a RAM, and its operation is realized in accordance with an operation program stored 
45 in the ROM or RAM. In this case, a program for realizing the function of each function block of the code book making 
apparatus may be externally supplied to the computer through a recording medium to make the function block operate 
in accordance with the program. 

[0140] In this case, as a recording medium which stores the program, for example, a floppy disk, a hard disk, an 
optical disk, an optical magnetic disk, a CD-ROM, a CD-I, a CD-R, a CD-RW, a DVD, a zip, a magnetic tape, or a non- 

so volatile memory card can be used. 

[0141] The program is incorporated in the embodiments of the present invention not only when the functions of the 
above-described embodiments are realized when the computer executes the supplied program but also when the func- 
tions of the above-described embodiments are realized by the program cooperating with the OS (Operating System) or 
another application software running on the computer, or the functions of the above-described embodiments are real- 

55 ized when part or all of the processing of the supplied program is executed by the function expansion board or function 
expansion unit of the computer. 
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(Fifth Embodiment) 

[0142] Fig. 1 2 is a function block diagram showing the construction of an apparatus for making a code book accord- 
ing to the fifth embodiment. Fig. 13 is a function block diagram showing the construction of a vector quantizing device 
5 for executing data compression using the made code book. Figs. 14 and 15 are illustrations showing examples of made 
code vectors (pattern images). 

[0143] Generally, most parts of a face image are occupied by patterns whose pixel values smoothly change as a 
whole. The change is monotonic and very little. In a landscape image as well, patterns whose pixel values smoothly 
change as a whole are partially present. On the other hand, in a character or the like, generally, pixel values abruptly 
10 change, and the change is very great. Even a landscape image has a portion where the pixel values abruptly change, 
like a character. 

[0144] As described above, all images which belong to various categories are roughly constructed by a pattern (to 
be referred to as a "solid pattern" hereinafter) where pixel values smoothly change as a whole and a pattern (to be 
referred to as an "edge pattern" hereinafter) where pixel values abruptly change. In this embodiment, taking this char- 

15 acteristic of an image into consideration, a code for a solid pattern and a code for an edge pattern are generated. When 
the codes for the two patterns are appropriately combined, they can cope with various images. 
[0145] As codes for solid patterns, for example, patterns which monotonically change in eight directions are gener- 
ated, as shown in Fig. 14. More specifically, a pattern whose pixel value (e.g., luminance value) gradually changes from 
one of the edge portions (upper, lower, left, and right sides and four corner points) of a 4 x 4 pixel block is generated. 

20 In this case, a 4 x 4 pixel code vector is generated as an example. However, the present invention is not limited to this 
size. 

[0146] Referring to Fig. 14, (a) shows a pattern whose luminance value gradually increases, as A -> B -» C -> D, 
from the left side to the right side of the block in units of vertical lines, (b) shows a pattern whose luminance value grad- 
ually increases from the right side to the left side of the block in units of vertical lines, (c) shows a pattern whose lumi- 
25 nance value gradually increases from the lower side to the upper side of the block in units of horizontal lines, and (d) 
shows a pattern whose luminance value gradually increases from the upper side to the lower side of the block in units 
of horizontal lines. 

[0147] (e) shows a pattern whose luminance value gradually increases from the upper left corner to the lower right 
corner of the block in units of oblique lines, (f) shows a pattern whose luminance value gradually increases from the 
30 upper right corner to the lower left corner of the block in units of oblique lines, (g) shows a pattern whose luminance 
value gradually increases from the lower left corner to the upper right corner of the block in units of oblique lines, and 
(h) shows a pattern whose luminance value gradually increases from the lower right corner to the upper left corner of 
the block in units of oblique lines. 

[0148] Of these patterns of eight types shown in Fig. 14, one of the patterns shown in Figs. 14(a) to 14(d) and one 
35 of the patterns shown in Figs. 14(e) to 14(h), i.e. a total of two types are generated and registered in advance before 
actual execution of vector quantization. The remaining patterns of six types are generated in actually executing vector 
quantization, as will be described later. Assume that the patterns (to be referred to as "basic patterns" hereinafter) 
shown in Figs. 14(a) and 14(e) are generated in advance for the descriptive convenience. 

[0149] The procedure of generating the basic solid pattern will be described with reference to the code book making 

40 apparatus shown in Fig. 1 2 and the flow chart shown in Fig. 1 6. 

[0150] Referring to Fig. 1 6, first in step S101 , for example, a 4 x 4 pixel block is classified into several groups. For, 
e.g., the basic pattern shown in Rg. 14(a), the block is divided into four groups A to D in units of vertical lines. 
[0151] In performing this grouping, first, the user designates a start point in the block using a start point designating 
section 1 01 shown in Fig. 1 2. To register the pattern shown in Rg. 14(a) as a basic pattern, the four pixels (group A) at 

45 the left side in the block are designated as a start point. Note that the start point designating section 1 01 is constructed ' 
by an input device such as a keyboard or a mouse. 

[0152] A grouping section 102 performs grouping in accordance with the start point designated by the start point 
designating section 101 . For example, to generate the pattern shown in Fig. 14(a) or 14(b) as a basic pattern, grouping 
is performed in units of lines in the vertical direction, or to generate the pattern shown in Rg. 14(c) or 14(d) as a basic 
so pattern, grouping is performed in units of lines in the horizontal direction. To generate the patterns shown in Rgs. 14(e) 
to 14(h) as basic patterns, grouping is performed in units of lines in the oblique directions. 

[0153] As described above, when one of the patterns shown in Figs. 14(a) to 14(d) and one of the patterns shown 
in Figs. 14(e) to 14(h) are registered as basic patterns, all the remaining patterns are generated by arithmetic operation. 
Hence, for example, the basic patterns can always be fixed to the patterns shown in Figs. 14(a) and 14(e). In this case, 
55 the start point designating section 1 01 is unnecessary. 

[0154] Next in step S102, the user inputs at least one increment h of the luminance value at the end point when 
viewed from the start point in the block using an increment input section 1 03 shown in Rg. 12. The increment input sec- 
tion 103 is also constructed by an input device such as a keyboard or mouse, instead of inputting the increment h by 
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the user, the apparatus may set a predetermined default value. 

[0155] In step S1 03, a start point luminance value setting section 1 04 shown in Fig. 12 sets the luminance value at 
the start point in the block. To give the luminance value at the start point, for example, the range of 



is equally divided into n parts, and each equally divided value is set as the luminance value at the start point Although 
the equally divided value is given here, it need not always be the equally divided value as far as it falls within the range 
of 0 to (intermediate value of the possible range of luminance values - increment h). In addition, although luminance 
10 values are given here by arithmetic operation, the user may arbitrarily input the luminance value at the start point within 
the above range by his/her discretion. 

[0156] When necessary pieces of information including the increment h and the luminance value at the start point, 
are set, in step S104, a code book making section 109 shown in Fig. 12 executes arithmetic operation of, e.g., linear 
interpolation on the basis of the luminance value at the start point and the increment h of luminance value, thereby ca!- 
is culating the luminance value of each group. Thus, the code of a pattern whose luminance value gradually increases 
from the start point to the end point in units of groups is generated. 

[0157] In this embodiment, since the luminance value at the start point is given by processing in step S1 03, all lumi- 
nance values belonging to each group in the block are smaller than the intermediate value of the possible range of lumi- 
nance values. That is, the code of the basic solid pattern generated here is a relatively dark image whose luminance 

20 value as a whole is smaller than the intermediate value. 

[0158] In step S102, at least one increment h is given, and in step S103, luminance values at the start point are 
given on the basis of the value of each increment h. Hence, codes are generated for the basic pattern shown in Fig. 
14(a) on the basis of different luminance values. One increment h and one luminance value at the start point may be 
given to generate only one basic pattern. 

25 [0159] The codes (code vectors) generated in the above way are stored in a code book data memory 1 1 0 as a basic 
solid pattern code book in step S105. 

[0160] In this example, a pattern whose luminance value gradually increases from the start point to the end point 
in a block is generated. Conversely, a pattern whose luminance value gradually decreases may be generated. 
[0161] On the other hand, as the codes of basic patterns related to edges, for example, patterns of 12 types as 
30 shown in Rg. 15 are generated as patterns whose luminance values abruptly change. In all edge patterns generated 
here, the edge portion is present on at least one of the four pixels constituting the left side in the block. Although the 
basic patterns of 12 types are shown, the number of types is not limited to 12. 

[0162] The procedure of generating a basic edge pattern will be described with reference to the code book making 
apparatus shown in Rg. 1 2 and the flow chart shown in Rg. 1 7. 
35 [0163] Referring to Fig. 1 7, first in step S1 1 1 , several reference patterns which should be employed as edge pat- 
terns are input using a pattern input section 105 shown in Rg. 12. In this case, with reference to, e.g., a block in the 
original image, which is present at an edge where the difference between black and white is clear, the luminance struc- 
ture is input as the luminance structure of an edge pattern. 

[0164] When several (12 in the example shown in Fig. 15) patterns are input from the original image, in step S1 12, 
40 a quantizing section 106 quantizes the luminance value of each pixel in the blocks constituting the patterns, thereby 
expressing the luminance values in the blocks using only predetermined values. 

[0165] In step S1 1 3, for each input and quantized pattern, a minimum luminance value subtracting section 1 07 sub- 
tracts the minimum luminance value in each block from the luminance values of all pixels in the block. Thus, the lumi- 
nance value of each pixel in the block is expressed by only an increment value (difference value) with respect to the 

45 minimum luminance value. In step S114, a luminance value change section 108 also generates patterns in which the 
luminance value of each pixel in the block is changed to make variations of the edge pattern to be registered. 
[0166] For example, the luminance values of all pixels in the block of the pattern generated by the minimum lumi- 
nance value subtracting section 1 07 are equally divided into m parts, and each equally divided value is set as the lumi- 
nance value of each pixel, thereby increasing the number of patterns to m. When this processing is ended, the 

so difference between the minimum luminance value (it is set to 0 in step S1 1 3) and the maximum luminance value in the 
block, i.e., an increment h* is known. 

[0167] Next, in step S1 15, the start point luminance value setting section 1 04 shown in Rg. 12 sets the luminance 
value (minimum luminance value) at the start point in the block. To give the luminance value at the start point, for exam- 
ple, the range of ' 



is equally divided into k parts, and each equally divided value is set as the luminance value at the start point In this 
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0 to (intermediate value of the possible range of luminance values - increment h) 
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0 to (maximum value of the possible range of luminance values - increment h') 
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case as well, the value need not always be an equally divided value, as in step S1 03 shown in Fig. 1 6. In addition, the 
user may arbitrarily Input a luminance value within the above range by his/her discretion. 

[0168] When necessary pieces of information including the luminance value at the start point, are set, in step S1 1 6, 
the code book making section 109 shown in Fig. 12 calculates the luminance value of each pixel in the block on the 
basis of the luminance value at the start point and the luminance value of each pixel of the patterns generated in step 
S1 1 4. Thus, codes of edge patterns whose luminance values abruptly change are generated. The codes (code vectors) 
generated in the above way are stored in the code book data memory 1 10 as a basic edge pattern code book in step 
S117. 

[0169] An construction and operation of actually executing vector quantization using the basic pattern code books 
made in the above way and stored in the code book data memory 1 10 will be described next. 
[0170] Rg. 1 3 is a function block diagram showing the schematic construction of a vector quantizing device accord- 
ing to this embodiment. Fig. 18 is a flow chart showing the operation of this vector quantizing device. 
[0171] First in step S1 21 shown in Fig. 1 8, an original image input section 121 inputs arbitrary image data as a com- 
pression target. In step S122, a code book arithmetic operation section 122 reads out the basic pattern code books 
stored in the code book data memory 1 1 0. In this case, all basic patterns of the solid patterns and edge patterns are 
read. 

[0172] In step S123, the code book arithmetic operation section 122 that has read the basic patterns rotates each 
read basic pattern through 90° four times, thereby generating the codes of different patterns from the basic pattern. For 
example, when the patterns shown in Figs. 14(a) and 14(e) are registered as the basic patterns of solid patterns, the 
patterns shown in Figs. 14(b) to 14(d) and Figs. 14(f) to 14(h) are generated by this processing. For the edge patterns 
as well, the basic patterns of 12 types shown in Fig. 1 5 are rotated to generate different patterns from these basic pat- 
terns. The number of patterns of codes increases to four times. 

[0173] In step S124, the code book arithmetic operation section 122 also executes, for each pattern obtained in 
step S123, processing of inverting the white and black portions (processing of folding back the luminance value with 
respect to the intermediate value), thereby further generating codes of different patterns. 

[0174] With such rotation processing and white/black inversion processing, even when the number of patterns reg- 
istered in the code book data memory 1 10 is relatively small, the number of patterns actually used in vector quantization 
becomes very large, so a pattern greatly similar to the original image is present at a very high possibility. 
[0175] For a solid pattern, the patterns obtained by rotation processing will not be the same. In addition, since a 
basic solid pattern generated in advance is a relatively dark pattern whose luminance values of all pixels are smaller 
than the intermediate value, the patterns obtained by white/black inversion processing are relatively bright patterns 
whose luminance values of all pixels are larger than the intermediate value. Hence, in this case as well, the patterns 
obtained by rotation processing will not be the same. 

[0176] For an edge pattern, in inputting the reference pattern with reference to the original image at the first stage, 
the pattern is input assuming whether the same patterns are to be generated by rotation processing or white/black 
inversion processing. However, this operation is not always easy. Such disadvantage can be avoided by, e.g., providing, 
in the code book making apparatus shown in Fig. 12, an arithmetic operation section for executing rotation processing 
or white/black inversion processing, and when comparison between the arithmetic operation result with the original data 
reveals the same patterns, outputting an error. 

[0177] In step S1 25 shown in Rg. 1 8, arithmetic operation of vector quantization (VQ) is executed on the basis of 
the original image data input in step S121 and the code data generated by the code book arithmetic operation section 
122. More specifically, first, using the original image data and code data, a similarity arithmetic operation section 123 
shown in Fig. 13 calculates the similarity therebetween in units of blocks. 

[0178] The similarity is a numerical value which is obtained by inputting, to a certain function, vector data consti- 
tuted by pixel values in a block extracted from original image data and vector data constituted by pixel values in the block 
of code vector and represents the degree of similarity therebetween. A representative example of such a function is a 
function for obtaining the Manhattan distance (absolute difference value distance) or Euclidean distance between two 
input vector data. 

[0179] A code determining section 124 determines, in units of blocks, a code vector having the largest similarity 
(the smallest Manhattan distance or Euclidean distance) for the code vectors generated by the code book arithmetic 
operation section 122. In step S126, a code corresponding to the determined code vector is applied to the block, 
thereby outputting compressed data. 

[0180] As described above in detail, according to this embodiment, in consideration of the fact that images of ail 
types are constituted by combinations of solid patterns and edge patterns, the codes of solid patterns and the codes of 
edge patterns are generated in advance. At this time, as shown in Figs. 1 6 and 1 7, on the basis of the input reference 
information, basic patterns are standardized and generated according to a predetermined processing procedure. 
[0181] Hence, when thus generated solid pattern codes and edge pattern codes are used, and data compression 
is executed for various data including data whose luminance value monotonically changes and data whose luminance 
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value abruptly changes, the quality of the image reconstructed from the compressed data can be improved. That is, 
according to this embodiment, a greatly versatile code book capable of obtaining high-quality reconstructed images for 
various images can be realized. 

[0182] In this embodiment, when actual vector quantization is executed using the above-described code books, 
5 codes of different variations are generated by rotation processing or white/black inversion processing. For this reason, 
the code of a pattern closer to the original image can be applied, and the quality of the reconstructed image can be fur- 
ther improved. In this case, these generated codes need not be stored in the code book data memory 1 10 in advance 
either, the capacity of the code book data memory 1 1 0 can be suppressed. 

[0183] In the above embodiment, the basic pattern code books are made in advance and stored in the code book 
10 data memory 1 10. However, only pieces of information (e.g., information including the position of the start point, start 
point luminance value, the increment from the start point to the end point) as a reference for basic pattern generation 
may be stored, and the codes of various patterns, including the basic patterns, may be generated in actually executing 
vector quantization. In this case, the memory capacity can be made smaller. 

[0184] In the above embodiment, rotation processing and white/black inversion processing are performed in exe- 
15 cuting vector quantization. However, these processes may be performed in advance before execution of vector quanti- 
zation and stored in the code book data memory 1 10. In this case, although the capacity of the code book data memory 
110 becomes large, the advantage that a versatile code book can be provided is obtained. In addition, since the arith- 
metic operation amount in executing vector quantization can be reduced, the processing speed becomes high. 
[0185] In the above embodiment, to increase the number of patterns of usable code vectors, equally divided values 
20 are employed as luminance values at the start point in step S103 shown in Fig. 16 and step S1 15 shown in Rg. 17. 
However, in order to suppress the capacity of the code book data memory 1 1 0 as small as possible, only one luminance 
value may be employed within the above-described range. 

[0186] Processing in steps S1 1 3 to S1 1 6 shown in Fig. 1 7 is also done to increase the number of patterns of usable 
code vectors. Hence, as described above, in order to suppress the capacity of the code book data memory 1 10 as small 
25 as possible, these steps may be omitted, and only processing of standardizing the pixel values may be performed in 
step S112. 

[0187] However, processing as in the above embodiment is preferably executed not only to reduce the capacity of 
the code book data memory 1 1 0 as small as possible but also to improve the quality of the reconstructed image as 
much as possible. 

30 [0188] In the above embodiment, both rotation processing and white/black inversion processing are performed. 
However, only one of them may be executed. 

[0189] In the above embodiment, in calculating similarity by the similarity arithmetic operation section 1 23, a code 
vector is rotated or inverted by the code book arithmetic operation section 122. Conversely, the original image may be 
rotated or inverted to calculate the similarity without processing the code vector. 
35 [0190] In the above embodiment, in generating a basic solid pattern, a pattern which is relatively dark as a whole 
is generated. Conversely, a relatively bright pattern may. be generated. 

[0191] Each of the function blocks shown in Figs. 12 and 13 is constructed by, e.g., a microcomputer system com- 
prising a CPU or an MPU, a ROM, and a RAM such that its operation can be realized in accordance with an operation 
program stored in the ROM or RAM, or constructed by hardware. In this case, although Figs. 12 and 13 are independ- 

40 ently illustrated, these constructions may be combined to form one vector quantizing device. 

[0192] Additionally, an operation program code for realizing the function of each function block may be supplied 
from an external recording medium to the computer, and each function block may be operated in accordance with the 
program. In this case, as a recording medium which stores the program, for example, a floppy disk, a hard disk, an opti- 
cal disk, an optical magnetic disk, a CD-ROM, a CD-I, a CD-R, a CD-RW, a DVD, a zip, a magnetic tape, or a nonvolatile 

45 memory card can be used. 

(Sixth Embodiment) 

[0193] Rg. 1 9 is a block diagram showing a construction of a system for data compression/decompression accord- 
so ing to the sixth embodiment. Fig. 20 is an illustration for explaining the operation principle of the operation according to 
this embodiment The principle will be described first with reference to Fig. 20. 

[0194] As shown in Fig. 20, in this embodiment, blocks (for example, one block has 4x4 pixels) extracted from an 
original image in executing vector quantization are classified into blocks (to be referred to as low-frequency patterns or 
solid patterns hereinafter) each having pixel values gradually changing in a predetermined direction in the block and 
55 blocks (to be referred to as high-frequency patterns or edge patterns hereinafter) each having pixel values abruptly 
changing in the block. 

[0195] Vector quantization (VQ) processing is independently performed for the blocks of solid patterns and edge 
patterns using a low-frequency code book and high-frequency code book, which are prepared in advance for the 
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respective patterns, and results obtained for the respective patterns are combined to obtain compressed data. Although 
individual blocks are not illustrated in Fig. 20, only the blocks of solid patterns are included in the image of the low-fre- 
quency pattern, and only the blocks of edge patterns are included in the image of the high-frequency pattern. 
[0196] Fig. 19 shows a construction for realizing such operation. 

[0197] Referring to Fig. 1 9, an image input section 201 inputs image data as a compression target. This image input 
section 201 has a function of segmenting the entire input image into blocks each formed from, e.g., 4x4 pixels and 
outputting an image in units of blocks. The image data as a compression target can be either a still image or a moving 
picture. The image data can be either a monochromatic image or a color image. 

[0198] A pixel arithmetic operation section 202 executes arithmetic operation necessary to determine whether an 
input block image corresponds to a solid pattern or edge pattern. For example, the minimum luminance value and max- 
imum luminance value are detected from pixels in the block, and the difference therebetween is calculated. When this 
difference is small, the image corresponds to a solid pattern whose luminance value gradually changes. When the dif- 
ference is large, the image corresponds to an edge pattern whose luminance value abruptly changes. 
[0199] A search threshold value input section 203 inputs a threshold value necessary for pattern determination 
based on the difference between the minimum luminance value and the maximum luminance value in the block, which 
is calculated by the pixel arithmetic operation section 202. A code-book-scheme compressing section 204 determines 
whether the block is a solid pattern or edge pattern on the basis of the arithmetic operation result received from the pixel 
arithmetic operation section 202 and the threshold value received from the search threshold value input section 203, 
and executes vector quantization processing using an appropriate code book according to the pattern. 
[0200] More specifically, when the block is a solid pattern, vector quantization is executed using a solid pattern code 
book 205a stored in a code book storage section 205 in advance. On the other hand, when the block is an edge pattern, 
vector quantization is executed using an edge pattern code book 205b stored in the code book storage section 205 in 
advance. The code book storage section 205 stores in advance as code vectors pixel patterns each having the same 
size (4x4 pixel block) as that of the block extracted from the original image. 

[0201 ] In the solid pattern code book 205a, code vectors of patterns which monotonically change in eight directions 
are registered, as shown in Fig. 21(a). More specifically, a set of patterns each having a pixel value (e.g., luminance 
value) gradually changing from as the start point one of the edge portions (upper, lower, left, and right sides and four 
corner points) of a block formed from 4x4 pixels is registered. Although only eight patterns are illustrated, a number of 
solid patterns are actually registered with variations in luminance value at the start point or degree of change in lumi- 
nance. 

[0202] In the edge pattern code book 205b, code vectors of patterns each having a luminance value abruptly 
changing are registered, as shown in Fig. 21(b). Although only 12 patterns are illustrated, a number of edge patterns 
are actually registered with variations or including patterns other than those illustrated here. 

[0203] Referring back to Fig. 19, a code number output section 206 outputs a code number string obtained as a 
result of vector quantization executed by the code-book-scheme compressing section 204 in units of blocks. In this 
embodiment, the code vectors constituting the solid pattern code book 205a and edge pattern code book 205b are 
assigned a series of code numbers (addresses of a storage device or the like), and a code number string corresponding 
to code vectors searched as code vectors having large similarities is output in units of blocks. The construction on the 
compressing side has been described above. 

[0204] A code number input section 207 receives the code number string of blocks output from the code number 
output section 206 on the compressing side. The code number output section 206 and code number input section 207 
can be connected through a communication path such as a network such that a code number is transferred through this 
network. Alternatively, the code number string output from the code number output section 206 may be temporarily 
stored in a storage medium such as a floppy disk and input to the decompressing side through the storage medium. 
[0205] A code-book-scheme decompressing section 208 executes processing of reading out, from a code book 
storage section 209, the pattern images of code vectors corresponding to the code number sequence received from the 
code number input section 207 and embedding the pattern images at corresponding block positions, thereby generating 
a reconstructed image. When an input code number corresponds to a solid pattern, a corresponding code vector is read 
out from a solid pattern code book 209a. When a code number corresponds to an edge pattern, a corresponding code 
vector is read out from an edge pattern code book 209b. 

[0206] Like the code book storage section 205 on the compressing side, the code book storage section 209 stores 
in advance, as code vectors, pixel patterns each having the same size (4x4 pixel block) as the block extracted from 
the original image. As the code books, the code books on the compressing side can be transmitted and stored before 
decompression processing. Alternatively, identical code books may be stored from the beginning. 
[0207] The reconstructed image generated by the code-book-scheme decompressing section 208 is supplied to an 
image display device or a storage device 210 and displayed as an image or stored as image data. The construction on 
the decompressing side has been described above. 

[0208] The detailed operation of the system for data compression/decompression according to this embodiment 
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having the above construction will be described next with reference to the flow charts shown in Figs. 22 and 23. 
[0209] Fig. 22 shows the operation on the compressing side. Referring to Fig. 22, first in step S201, processing 
processing is executed. In this case, processing of clearing the block counter for counting processed blocks is executed. 
[0210] In step S202, a threshold value T H for search is given, and then in step S203, one image block is input. In 
s step S204, for the input image block, the difference between the maximum luminance value and the minimum lumi- 
nance value in the block is calculated, and it is determined whether the calculation result is larger than the search 
threshold value T H . 

[0211] If the calculated difference value is larger than the search threshold value T H , the block is the image of an 
edge pattern. Hence, the flow advances to step S205to execute vector quantization processing using the edge pattern 
w code book 205b and search for the code vector of an edge pattern most similar to the input image block. 

[0212] On the other hand, if the calculated difference value is not larger than the search threshold value T Hl the 
block is the image of a solid pattern. Hence, the flow advances to step S206 to execute vector quantization processing 
using the solid pattern code book 205a and search for the code vector of a solid pattern most similar to the input image 
block. 

15 [0213] When vector quantization processing is ended in step S205 or S206, the flow advances to step S207, the 
image of the input block is replaced with a code number corresponding to the search code vector and encoded. After 
that, in step S208, the replaced code number is output 

[0214] The flow advances to step S209 to determine whether the above-described processing is ended for all 
blocks in the image. If NO in step S209, the value of the block counter is incremented by one in step S21 0, and the flow 
20 returns to step S203 to repeat the above processing. When optimum codes are obtained for all blocks in the image in 
the above way, the original image is compressed. Note that processing in step S208 can be replaced with that in step 
S209 to output the code number string of one image together. 

[0215] Fig. 23 shows the operation on the decompressing side. Referring to Fig. 23, first in step S21 1 , processing 
processing is executed. In this case, processing of clearing the block counter for counting processed blocks is executed. 

25 In step S21 2, a code number specified on the compressing side is input. 

[0216] In step S213, on the basis of the input code number, the pattern image of a code vector corresponding to 
the code number is searched from the solid pattern code book 209a or edge pattern code book 209b. The pattern 
image is read out and embedded at a corresponding block position (more specifically, the pattern image is stored at a 
predetermined position of a reconstructed image buffer). 

30 [0217] After the reconstructed image generated is display on a display or stored in a storage medium in step S21 4, 
the flow advances "to step S215 to determine whether the above-described processing is ended for all blocks in the 
image. If NO in step S215, the value of the block counter is incremented by one in step S21 6, and then the flow returns 
to step S21 2 to repeat the above processing. 

[0218] When pattern images are reconstructed for all blocks in the image, the original image is reconstructed. Note 
35 that processing in step S214 can be replaced with that in step S215 to execute image display or storage processing 
after one reconstructed image is entirely generated. 

[0219] In the above example, the solid pattern section and edge pattern section are provided in one code book. 
However, as shown in Fig. 24, two code books, i.e., the code book for solid patterns and that for edge patterns may be 
separately prepared. More specifically, in this example, solid pattern code book storage sections 21 1 and 213 for stor- 
40 ing code books for solid patterns and edge pattern code book storage sections 212 and 21 4 for storing code books for 
edge patterns are separately prepared. 

[0220] In this construction, since the code book storage sections are independently assigned code numbers 
(addresses or the like), a solid pattern and an edge pattern may be assigned a single code number. Hence, to identify 
an input code number corresponding to a solid pattern or edge pattern in decompression processing, flag information 

45 is transmitted together with a code number. Figs. 25 and 26 are flow charts showing this operation. 

[0221] In the compressing-side operation shown in Fig. 25, the processes in steps S205, S206, and S208 shown 
in Fig. 22 are replaced with processes in step S221 , S222, and S223, respectively. In step S221, when the difference 
value calculated between the maximum luminance value and the minimum luminance value in a block is larger than the 
search threshold value T H , vector quantization processing is executed using the code book in the edge pattern code 

so book storage section 21 2, and the flag is set to "1 \ 

[0222] In step S222, when the calculated difference value is not larger than the search threshold value T H , vector 
quantization processing is executed using the code book in the solid pattern code book storage section 21 1, and the 
flag is set to "0". In step S223, the flag information set in the above manner is output in addition to the replaced code 
number. 

55 [0223] In the decompressing-side operation shown in Fig. 26, the process in step S21 2 shown in Fig. 23 is replaced 
with the process in step S224 and the processes in step S213 is replaced with the processes in step S225, S226, and 
S227. In step S224, the above flag information is input in addition to the code number specified on the compressing 
side. In step S225, It is determined whether the input flag is "1 \ If YES in step S225, the flow advances to step S226. 
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If NO in step S225, the flow advances to step S227. 

[0224] In step S226, on the basis of the input code number, the pattern image of a code vector corresponding to 
the code number is read out from the edge pattern code book storage section 214 and embedded at a corresponding 
block position. In step S227, on the basis of the input code number, the pattern image of a code vector corresponding 
5 to the code number is read out from solid pattern code book storage section 213 and embedded at a corresponding 
block position. 

[0225] The same reference numerals as in Fig. 19 denote the components having the same functions in Fig. 24, 
the same step numbers as in Figs. 22 and 23 denote the same processes in Figs. 25 and 26, and a detailed description 
thereof will be omitted. 

10 [0226] As described above, in this embodiment, in executing vector quantization, instead of sequentially extracting 
blocks from one image and executing vector quantization using one code book, the luminance distribution in each block 
extracted from the original image is detected, and it is determined whether the block is a solid pattern or edge pattern 
of the image. 

[0227] When the extracted block is a solid pattern, a code vector having large similarity is selected from the solid 
is pattern section in the code book or an independently prepared solid pattern code book. When the extracted block is an 
edge pattern, a code vector having large similarity is selected from the edge pattern section in the code book or an inde- 
pendently prepared edge pattern code book. 

[0228] As described above, in this embodiment, since a significance is given in constituting one image by blocks, 
and vector quantization is executed accordingly, an optimum pattern image can be selected for a solid pattern from a 
20 code book corresponding to solid patterns, and an optimum pattern image can be selected for an edge pattern from a 
code book corresponding to edge patterns. Hence, when an image is reconstructed using thus determined pattern 
images, a reconstructed image with higher quality can be obtained. 

(Seventh Embodiment) 

25 

[0229] The seventh embodiment of the present invention will be described next. As has been described in the back- 
ground art, in obtaining a natural reconstructed image matching the human visual characteristic especially for a solid 
pattern, the direction of change in luminance value of each pixel in a block acts as an important factor. For a solid pat- 
tern, the direction of luminance change can be predicted from the pixel values at the four corners in the block. 
30 [0230] For example, a block shown in Fig. 27 is the block of a solid pattern in which the luminance value gradually 
increases from the upper right pixel to the lower left pixel in the block, or the luminance value gradually decreases from 
the lower left pixel to the upper right pixel. In this case, when the pixel values at the four corners are known, the direction 
of change in luminance value in the block can be known. 

[0231] In the seventh embodiment, in obtaining similarity between the input vector of a block extracted from an orig- 
35 inal image and each code vector in a code book, arithmetic operation is performed for a solid pattern using only pieces 
of information on the pixels (four dimensions) at the four corners instead of arithmetic operation using pieces of infor- 
mation on all pixels (16 dimensions) in the block. 

[0232] The construction for implementing a system for data compression/decompression according to the seventh 
embodiment is the same as that shown in Fig. 19 or 24. However, the contents of vector quantization processing exe- 
40 cuted by a code-book-scheme compressing section 204 are different from those of the sixth embodiment. The flow 
chart showing the operation is also almost the same as in the sixth embodiment except the contents of search process- 
ing in step S206 shown in Rg. 22 and in step S222 shown in Fig. 25. 

[0233] More specifically, in the sixth embodiment, for example, the Manhattan distance or Euclidean distance is cal- 
culated using all the 1 6 pixels in a block, thereby obtaining similarity between two vectors. To the contrary, in the seventh 
45 embodiment, for a solid pattern, similarity such as the Manhattan distance is calculated using only pixels at the four cor- 
ners, and simultaneously, the direction of luminance change in the block is detected. A code vector having large simi- 
larity to the input vector of the original image and having the same direction of luminance change as that of the input 
vector is selected from a code book. 

[0234] With this construction, a disadvantage that an unnatural pattern image whose luminance in the block 
so changes in a direction opposite to that in the entire, image is selected can be properly prevented, and a more natural 
pattern image according to the human visual characteristic can be properly selected. This makes it possible to obtain a 
reconstructed image having a higher quality. In addition, since arithmetic operation for only four dimensions suffices, the 
processing speed can be increased. 

[0235] In the seventh embodiment, in executing vector quantization, only pieces of information on pixels at the four 
55 corners in a block are used for arithmetic operation, and pieces of information on the remaining pixels are not used. For 
this reason, each code vector in the code book may be constituted by only the four-dimensional information correspond- 
ing to the pixels at the four corners instead of constituting the code vector by 1 6-dimensional information as in the sixth 
embodiment. This reduces the storage capacity of the code book storage section, in addition, code vectors of a larger 
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number of types can be registered without increasing the storage capacity, and the quality of a reconstructed image can 
be further improved. 

[0236] In this case, however, the original image cannot be reconstructed using only the pixel information at the four 
corners in decompression processing. To do this, for example, for a solid pattern code book 205a in a code book stor- 
5 age section 205 shown in Fig. 1 9, each code vector is constituted using only the four-dimensional information, and for 
a solid pattern code book 209a in a code book storage section 209, each code vector is constituted using the 1 6-dimen- 
sional information. 

[0237] Alternatively, for both the solid pattern code books 205a and 209a, each code vector may be constituted by 
only the four-dimensional information and pieces of information on pixels except the four corners may be generated 
io from the pieces of information on the pixels at the four corners by arithmetic operation, e.g., linear interpolation. In this 
case, for example, an arithmetic operation section for calculating linear interpolation or the like is arranged on the output 
side of a code-book-scheme decompressing section 208 shown in Fig. 19. 

[0238] For code vectors which have the same luminance values at the start and end points but different directions 
of luminance change or code vectors which have the same form of luminance change but different luminance values of 
is pixels, only a representative code vector may be stored, and rotation arithmetic operation of a block of white/black inver- 
sion arithmetic operation of a luminance value (processing of folding back the luminance value with respect to the inter- 
mediate value) may be executed on the basis of the code vector to generate other code vectors. 
[0239] In the above embodiments, the block size is set to 4 x 4 pixels. However, the present invention is not limited 
to this. 

20 [0240] In the above embodiments, to discriminate between a solid pattern and an edge pattern, it is checked 
whether the difference between the maximum luminance value and the minimum luminance value in a block is larger 
than a predetermined threshold value. However, the present invention is not limited to this method as far as the two pat- 
terns can be discriminated. 

[0241] In addition, blocks may be classified into different patterns using other information (e.g., color information), 
25 and vector quantization may be independently executed for the blocks. 

[0242] The classified patterns are not limited to the above-described two types, and blocks may be classified into 
patterns of a larger number of types. 

[0243] Each of the function blocks shown in Fig. 19 or 24 can be constructed by either hardware or a microcom- 
puter system comprising a CPU or an MPU, a ROM, and a RAM in this embodiment such that its operation is realized 

30 in accordance with an operation program stored in the ROM or RAM. The present invention also incorporates a case 
wherein a software program for realizing the functions to realize the function of each function block is supplied to the 
RAM, and each function block is made to operate in accordance with the program. 
. [0244] In this case, the software program itself constitutes the functions of the above-described embodiments, and 
the program itself, and the means for supplying the program to the computer, and for example, a recording medium 

35 which stores the program constitutes the present invention. As a recording medium which stores the program, for exam- 
ple, not only the ROM or RAM but also a floppy disk, a hard disk, an optical disk, an optical magnetic disk, a CD-ROM, 
a CD-I, a CD-R, a CD-RW, a DVD, a zip, a magnetic tape, or a nonvolatile memory card can be used. 
[0245] The program is incorporated in the embodiments of the present invention not only when the functions of the 
above-described embodiments are realized when the computer executes the supplied program but also when the func- 

40 tions of the above-described embodiments are realized by the program cooperating with the OS (Operating System) or 
another application software running on the computer. 

[0246] The present invention also incorporates a case wherein the functions of the above-described embodiments 
are realized when the supplied program is stored in a memory provided in the function expansion board of the computer 
or the function expansion unit connected to the computer, and the CPU provided in the function expansion board or 
45 function expansion unit executes part or all of actual processing on the basis of instructions of the program. 

Industrial Applicability 

[0247] As has been described above, according to the present invention, by giving a desired value to the data of a 
so code vector, a greatly versatile code book capable of coping with various data including data which monotonically varies 
or data which abruptly varies can be realized without increasing the memory capacity for storing it. When the code book 
made by the present invention is used, a greatly versatile system for data compression/decompression, which can 
reconstruct high-quality images for various images even at a high compression ratio can be implemented. 
[0248] According to the present invention, in executing vector quantization, a pattern is discriminated on the basis 
55 of information in a block extracted from a compression target, and vector quantization is executed using an appropriate 
code book prepared for each pattern. Thus, a greatly versatile system for data compression/decompression, which can 
obtain a more natural reconstructed image according to the human visual characteristic when, e.g., an image is com- 
pressed, and the image is reconstructed using.a selected code vector, can be implemented. 
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[0249] In addition, for a solid pattern, similarity is calculated using only pieces of information at the four corners in 
a block, and simultaneously, the direction of change in the block is detected, and a code vector is selected on the basis 
of the result. Hence, a greatly versatile system for data compression/decompression, which can properly prevent dis- 
advantage that an unnatural code vector whose data value changes in the block in a direction opposite to that in the 
5 entire image is selected and obtain a reconstructed image with a higher quality, can be implemented. 

Claims 

1 . A method of making a code book used in vector quantization, said code book comprising a set of code vectors each 
10 of which is a data string including at least one unit of data, characterized in that 

a data string of a code vector is made with reference to one or more units of data in the data string constituting 
the code vector, by giving, to the remaining units of data in the data string, values which vary from the reference 
data value in order by a predetermined increment 

15 

2. A method of making a code book used in vector quantization, said code book comprising a set of code vectors each 
of which is a data string including at least one unit of data, characterized in that: 

a data string of a code vector is made by the manner that the data string constituting the code vector is classi- 
20 fied into data groups, the total range of the possible values of the respective units of data in the data string is 

divided by the number of classified data groups, and an arbitrary value in the divided range corresponding to 
the data group is selectively assigned as each data value in each data group. 

3. A method of making a code book used in vector quantization, said code book comprising a set of code vectors each 
25 of which is a data string including at least one unit of data, characterized in that: 

a data string of a code vector is made by the manner that the occupation rate of the maximum or minimum 
value of the possible values of the respective units of data in the data string constituting the code vector is set, 
the maximum or minimum value is assigned to arbitrary units of data constituting the data string in accordance 
30 with the set rate, and the minimum or maximum value is assigned to the other units of data than the units of 

data to which the maximum or minimum value is assigned. 

4. A method of making a code book used in vector quantization according to claim 3, characterized in that an inter- 
mediate value is assigned to predetermined units of data in accordance with the arrangement state of the units of 

35 data to which the minimum value is assigned. 

5. A method of making a code book used in vector quantization, said code book comprising a set of code vectors each 
of which is a data string including at least one unit of data, characterized in that 

40 said method includes at least two of: 

a first making method in which a data string of a code vector is made with reference to one or more units of 
data in the data string constituting the code vector, by giving, to the remaining units of data in the data string, 
values which vary from the reference data value in order by a predetermined increment; 
a second making method in which a data string of a code vector is made by the manner that the data string 

45 constituting the code vector is classified into data groups, the total range of the possible values of the respec- 

tive units of data in the data string is divided by the number of classified data groups, and an arbitrary value in 
the divided range corresponding to the data group is selectively assigned as each data value in each data 
group; and 

a third making method in which a data string of a code vector is made by the manner that the occupation rate 
so of the maximum or minimum value of the possible values of the respective units of data in the data string con- 

stituting the code vector is set, the maximum or minimum value is assigned to arbitrary units of data constitut- 
ing the data string in accordance with the set rate, the minimum or maximum value is assigned to the other 
units of data than the units of data to which the maximum or minimum value is assigned, and an intermediate 
value is assigned to predetermined units of data in accordance with the arrangement state of the units of data 
55 to which the minimum value is assigned; and 

code books made by at least two of the first to third making methods are combined to make one code book. 

6. An apparatus for making a code book used in vector quantization, said code book comprising a set of code vectors 
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each of which is a data string including at least one unit of data, characterized by comprising: 

reference value setting means for setting a reference data value to one or more arbitrary units of data in a data 
string constituting a code vector; 
s increment setting means for setting an increment with respect to the reference data value; and 

code vector making means for making the data string of the code vector as a set of data values obtained by 
sequentially changing the set reference data value by the set increment. 

7. An apparatus for making a code book used in vector quantization, said code book comprising a set of code vectors 
10 each of which is a data string including at least one unit of data, characterized by comprising: 

data classifying means for classifying a data string constituting a code vector into data groups; 
range dividing means for dividing the total range of the possible values of the respective units of data in the 
data string by the number of classified data groups; and 
75 code vector making means for making the data string of the code vector by selectively assigning, as each data 

value in each classified data group, an arbitrary value in the divided range corresponding to the data group. 

8. An apparatus for making a code book used in vector quantization, said code book comprising a set of code vectors 
each of which is a data string including at least one unit of data, characterized by comprising: 

20 

rate setting means for, in a data string constituting a code vector, setting the occupation rate of the maximum 
or minimum value of the possible values of the respective units of data in the data string; and 
code vector making means for making the data string of the code vector by assigning the maximum or mini- 
mum value to arbitrary units of data constituting the data string in accordance with the set rate and assigning 
25 the minimum or maximum value to the other units of data than the units of data to which the maximum or min- 

imum value is assigned. 

9. An apparatus for making a code book used in vector quantization according to claim 8, characterized in that said 
code vector making means assigns an intermediate value to predetermined units of data in accordance with the 

30 arrangement state of the units of data to which the minimum value is assigned. 

10. An apparatus for making a code book used in vector quantization, characterized by comprising means for making 
one code book by combining code books made by the code vector making means according to any two of claims 
6 to 8. 

35 

11. A computer-readable recording medium which stores a program of a procedure of making a code book used in vec- 
tor quantization, said code book comprising a set of code vectors each of which is a data string including at least 
one unit of data, characterized in that 

40 said recording medium records a program for causing a computer to execute a procedure of, with reference to 

one or more units of data in a data string constituting a code vector, making the data string of the code vector 
by giving, to the remaining units of data in the data string, values which vary from the reference data value in 
order by a predetermined increment. 

45 12. A computer-readable recording medium which stores a program of a procedure of making a code book used in vec- 
tor quantization, said code book comprising a set of code vectors each of which is a data string including at least 
one unit of data, characterized in that 

said recording medium records a program for causing a computer to execute a procedure of making a data 
so string of a code vector by classifying the data string constituting the code vector into data groups, dividing the 

total range of the possible values of the respective units of data in the data string by the number of classified 
data groups, and selectively assigning, as each data value in each data group, an arbitrary value in the divided 
range corresponding to the data group. 

55 13. A computer-readable recording medium which stores a program of a procedure of making a code book used in vec- 
tor quantization, said code book comprising a set of code vectors each of which is a data string including at least 
one unit of data, characterized in that 
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said recording medium records a program for causing a computer to execute a procedure of making a data 
string of a code vector by, in the data string constituting the code vector, setting the occupation rate of the max- 
imum or minimum value of the possible values of the respective units of data in the data string, assigning the 
maximum or minimum value to arbitrary units of data constituting the data string in accordance with the set 
5 rate, and assigning the minimum or maximum value to the other units of data than the units of data to which 

the maximum or minimum value is assigned. 

14. A computer-readable recording medium according to claim 13, characterized in that said recording medium 
records a program for causing the computer to execute a procedure of assigning an intermediate value to prede- 

10 termined units of data in accordance with the arrangement state of the units of data to which the minimum value is 
assigned. 

15. A computer-readable recording medium which records a code book used in vector quantization, said code book 
comprising a set of code vectors each of which is a data string including at least one unit of data, and having a data 

15 structure in which, with reference to one or more units of data, one codevector is constituted by a set of data values 
which vary from the reference data value in order by a predetermined increment. 

16. A computer-readable recording medium which records a code book used in vector quantization, said code book 
comprising a set of code vectors each of which is a data string including at least one unit of data, and having a data 

20 structure in which one code vector is constituted by classifying a data string constituting a code vector into data 
groups, dividing the total range of the possible values of the respective units of data in the data string by the number 
of classified data groups, and selectively assigning, as each data value in each data group, an arbitrary value in the 
divided range corresponding to the data group. 

25 17. A computer-readable recording medium which records a code book used in vector quantization, said code book 
comprising a set of code vectors each of which is a data string including at least one unit of data, and having a data 
structure in which one code vector is constituted by, in a data string constituting a code vector, setting the occupa- 
tion rate of the maximum or minimum value of the possible values of the respective units of data in the data string, 
assigning the maximum or minimum value to arbitrary units of data constituting the data string in accordance with 

30 the set rate, assigning the minimum or maximum value to the other units of data than the units of data to which the 
maximum or minimum value is assigned, and assigning an intermediate value to predetermined units of data in 
accordance with the arrangement state of the units of data to which the minimum value is assigned. 

18. An apparatus for making a code book used in vector quantization, said code book comprising a set of vectors each 
35 of which is a data string including at least one unit of data, characterized by comprising: 

solid pattern generating means for generating at least one type of solid pattern code whose data value gradu- 
ally varies in a block constituting the vector; and 

edge pattern generating means for generating at least one type of edge pattern code whose data value 
40 abruptly varies in the block. 

19. An apparatus for making a code book used in vector quantization according to claim 1 8, characterized by compris- 
ing storage means for storing the pattern codes generated by said solid pattern generating means and said edge 
pattern generating means, and 

45 

code calculating'means for, in executing the vector quantization, performing arithmetic operation for the pattern 
codes stored in said storage means to generate pattern codes different from the pattern codes. 

20. An apparatus for making a code book used in vector quantization according to claim 1 8 or 1 9, characterized in that 
so said solid pattern generating means generates a pattern code whose data value gradually varies from an arbitrary 

side and an arbitrary corner in the block to the opposite side and corner. 

21. An apparatus for making a code book used in vector quantization according to any one of claims 1 8 to 20, charac- 
terized in that said solid pattern generating means generates a pattern code in which, all data values in the block 

55 are constituted by values smaller or larger than an intermediate value of a possible range. 

22. An apparatus for making a code book used in vector quantization according to any one of claims 1 8 to 21 , charac- 
terized in that said solid pattern generating means generates pattern codes for which degrees of gradual changes 
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are the same, and data values themselves are different. 

23. An apparatus for making a code book used in vector quantization according to claim 1 8 or 1 9, characterized in that 
said edge pattern generating means comprises 

5 

pattern input means for inputting a reference pattern, and 

quantizing means for expressing the input reference pattern only by a predetermined data value group. 

24. An apparatus for making a code book used in vector quantization according to claim 1 8, 19, or 23, characterized in 
10 that said edge pattern generating means generates pattern codes for which the differences between data values in 

the block are the same, and data values themselves are different. 

25. An apparatus for making a code book used in vector quantization according to claim 24, characterized in that said 
edge pattern generating means generates, in addition to the pattern codes for which the differences between data 

75 values in the block are the same, pattern codes for which difference ratios are the same, and the data values them- 
selves are different. 

26. An apparatus for making a code book used in vector quantization according to claim 19, characterized in that said 
code calculating means performs at least one of arithmetic operations of block rotation processing and data value 

20 inversion processing for each pattern code stored in said storage means. 

27. A method of making a code book used in vector quantization, said code book comprising a set of vectors each of 
which is a data string including at least one unit of data, characterized in that: 

25 at least one type of solid pattern code whose data value gradually varies in a block constituting a vector and at 

least one type of edge pattern code whose data value abruptly varies in the block, are generated as basic pat- 
terns and stored in storage means; and 

in executing the vector quantization, pattern codes different from the basic patterns are generated by perform- 
ing arithmetic operation for the pattern codes stored in the storage means. 

30 

28. A method of making a code book used in vector quantization according to claim 27, characterized in that, before 
execution of the vector quantization, a solid pattern code whose data value gradually varies from an arbitrary side 
in the block to the opposite side and a solid pattern code whose data value gradually varies from an arbitrary corner 
in the block to the opposite corner are generated as the basic patterns and stored in the storage means. 

35 

29. A method of making a code book used in vector quantization according to claim 27, characterized in that that, 
before execution of the vector quantization, the edge pattern code is generated by inputting a reference pattern and 
at least executing quantization processing of expressing the input reference pattern only by a predetermined data 
value, and stored in the storage means as the basic pattern. 

40 

30. A method of making a code book used in vector quantization according to claim 27, characterized in that, in exe- 
cuting the vector quantization, at least one of arithmetic operations of block rotation processing and data value 
inversion processing is performed for each pattern code stored in the storage means. 

45 31. A vector quantizing device which forms, as a vector, a block from a data string including at least one unit of data, 
searches for a code vector similar to the vector extracted from a compression target from a code book prepared in 
advance, and outputs a code corresponding to the code vector, characterized by comprising: 

solid pattern generating means for generating at least one type of solid pattern code whose data value gradu- 
50 ally varies in the block; 

edge pattern generating means for generating at least one type of edge pattern code whose data value 
abruptly varies in the block; 

storage means for storing the pattern codes generated by said solid pattern generating means and said edge 
pattern generating means; 

55 code calculating means for, in executing the vector quantization, performing arithmetic operation for the pattern 

codes stored in said storage means to generate pattern codes different from the pattern codes; and 
vector quantizing means for executing the vector quantization using the pattern codes read out from said stor- 
age means and the pattern codes generated by said code calculating means. 
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32. A.method of making a code book used in vector guantization, said code book comprising a set of vectors each of 
which is a data string including at least one unit of data, characterized in that: 

at least one type of solid pattern code is generated in advance as a basic pattern and stored in storage means; 
5 and 

in executing the vector quantization, a pattern code different from the basic pattern is generated by performing 
arithmetic operation for the at least one type of pattern code which is stored in the storage means. 

33. A method of making a code book used in vector quantization according to claim 32, characterized in that the arith- 
io metic operation is at least one of rotation processing and data value inversion processing. 

34. A computer-readable recording medium characterized in that said recording medium records a program for causing 
a computer to execute a processing procedure of the code book making method according to claim 32 or 33. 

is 35. A vector quantizing device which forms, as a vector, a block from a data string including at least one unit of data, 
searches for a code vector similar to the vector extracted from a compression target from a code book prepared in 
advance, and outputs a code corresponding to the code vector, characterized by comprising: 

storage means for storing the code book; 
20 calculating means for, in executing the vector quantization, performing arithmetic operation for codes stored in 

said storage means to generate codes different from the stored codes; and 

vector quantizing means for executing the vector quantization using the codes read out from said storage 
means and the codes generated by said calculating means. 

25 36. A vector quantizing device used in vector quantization according to claim 35, characterized in that arithmetic oper- 
ation by said calculating means is at least one of rotation processing and data value inversion processing. 

37. A computer-readable recording medium which records a vector quantization program for forming, as a vector, a 
block from a data string including at least one unit of data, searching for a code vector similar to the vector extracted 

30 from a compression target from a code book prepared in advance, and outputting a code corresponding to the code 
vector, characterized in that said computer- readable recording medium records a program for causing a computer 
to execute: 

the calculating step of, in executing the vector quantization, performing arithmetic operation for codes stored in 
35 storage means to generate codes different from the stored codes; and 

the vector quantizing step of executing the vector quantization using the codes read out from the storage 
means and the codes generated in the calculating step. 

38. A computer-readable recording medium according to claim 37, characterized in that, as arithmetic operation in the 
40 calculating step, at least one of rotation processing and data value inversion processing is performed. 

39. A device for data compression, which forms, as a vector, a block from a data string including at least one unit of 
data, searches for a code vector similar to the vector extracted from a compression target from a code book pre- 
pared in advance, and outputs a code corresponding to the code vector, characterized by comprising: 

45 

code book storage means for storing a code book prepared for every different type of pattern; 
discriminating means for discriminating a type of pattern of data of the block on the basis of information in the 
block of the compression target; and 

vector quantizing means for executing vector quantization processing using the code books prepared for the 
so respective patterns in accordance with a discrimination result by said discriminating means. 

40. A device for data compression according to claim 39, characterized in that said discriminating means discriminates, 
on the basis of data values of elements in the block of the compression target, between a first pattern whose data 
value gradually varies in a certain direction in the block and a second pattern whose data value abruptly varies in 

55 the block. 

41. A device for data compression according to claim 40, characterized in that said discriminating means discriminates 
the block as the first pattern when the difference between the maximum and minimum values of the elements in the 
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block is smaller than a predetermined threshold value, and discriminates the block as the second pattern when the 
difference between the maximum and minimum values in the block is larger than the predetermined threshold 
value. 

5 42. A device for data compression according to any one of claims 39 to 41 , characterized in that said vector quantizing 
means obtains similarity for the blocks of different types of patterns by different processes. 

43. A device for data compression according to claim 42, characterized In that, for the first pattern in which the data 
value of each element in the block of the compression target gradually varies, said vector quantizing means obtains 

w the similarity using only data values of elements at the four comers in a rectangular block. 

44. A device for data compression according to claim 43, characterized in that said vector quantizing means detects a 
direction of data value change in the block from the data values at the four corners in the block and searches for 
the similar code vector also in consideration of the direction. 

15 

45. A device for data compression according to claim 43 or 44, characterized in that each code vector constituting the 
code book for the first pattern has only pieces of information on the elements at the four corners in the block. 

46. A device for data decompression which uses a data string including at least one unit of data as a vector, searches 
20 for a code vector corresponding to a compression code from a code book including at least one code vector, and 

assigns the code vector to a corresponding block position to reconstruct original data, characterized by comprising: 

code book storage means for storing a code book prepared for every different type of pattern; and 
decoding means for, on the basis of compression codes generated on the compressing side for the respective 
25 patterns of different types, searching for code vectors corresponding to the compression codes, from the code 

books prepared for the respective patterns. 

47. A device for data decompression according to claim 46, characterized in that the different types of patterns include 
a first pattern in which the data value of each element in the block of the compression target gradually varies in a 

30 certain direction in the block and a second pattern in which the data value abruptly varies in the block. 

48. A device for data decompression according to claim 47, characterized in that each code vector constituting the 
code book for the first pattern has only pieces of information on the elements at the four corners in the rectangular 
block. 

35 

49. A device for data decompression according to claim 48, characterized by further comprising calculating means for 
calculating, by arithmetic operation, pieces of information on the other elements on the basis of pieces of informa- 
tion on the elements at the four corners in the block. 

40 50. A method for data compression in which a block is formed, as a vector, from a data string including at least one unit 
of data, a code vector similar to the vector extracted from a compression target is searched from a code book pre- 
pared In advance, and a code corresponding to the code vector is output, characterized in that: 

a type of pattern of data in the block of the compression target is discriminated on the basis of information in 
45 the block and vector quantization processing is executed using code books prepared for the respective pat- 

terns in accordance with a discrimination result. 

51 . A method for data decompression according to claim 50, characterized in that the different types of patterns include 
a first pattern in which the data value of each element in the block of the compression target gradually varies in a 

so certain direction in the block and a second pattern in which the data value abruptly varies in the block. 

52. A method for data compression according to claim 51, characterized in that, in executing the vector quantization 
processing, for the blocks of the patterns of different types, similarities of vectors are obtained by different proc- 
esses, and, for the first pattern, the similarity is obtained using only data values of elements at the four corners in 

55 a rectangular block. 

53. A method for data compression according to claim 52, characterized in that a direction of data value change is 
detected in the block from the data values at the four corners in the block and the similar code vector is searched 
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also in consideration of the direction. 

54. A method for data decompression in which a data string including at least one unit of data is used as a vector, a 
code vector corresponding to a compression code is searched from a code book including at least one code vector, 
and the code vector is assigned to a corresponding block position to reconstruct original data, characterized in that 

on the basis of compression codes generated on the compressing side for the respective different types of pat- 
terns, code vectors corresponding to the compression codes are searched from code books prepared for the 
respective patterns. 

55. A method for data decompression according to claim 54, characterized in that the different types of patterns include 
a first pattern in which the data value of each element in the block of the compression target gradually varies in a 
certain direction in the block and a second pattern in which the data value abruptly varies in the block. 

56. A method for data decompression according to claim 55, characterized in that each code vector constituting the 
code book for the first pattern has only pieces of information on the elements at the four corners in a rectangular 
block, and, in searching for the code vector corresponding to the compression code and assigning the code vector 
to the corresponding block position, by arithmetic operation, pieces of information on the other elements are calcu- 
lated on the basis of pieces of information on the elements at the four corners in the block. 

57. A system for data compression/decompression including a device for data compression which forms, as a vector, 
a block from a data string including at least one unit of data, searches for a code vector similar to the vector 
extracted from a compression target from a code book prepared in advance, and outputs a code corresponding to 
the code vector, and a device for data decompression which searches for a code vector corresponding to the code 
from the code book and assigns the code vector to a corresponding block position to reconstruct original data, char- 
acterized in that 

said device for data compression comprises first code book storage means for storing a code book prepared 
for every different type of pattern, 

discriminating means for discriminating a type of pattern of data of the block on the basis of information in the 
block of the compression target, and 

vector quantizing means for executing vector quantization processing using the code books prepared for the 
respective patterns in accordance with a discrimination result by said discriminating means; and 
said device for data decompression comprises second code book storage means for storing a code book pre- 
pared for every different type of pattern, and 

decoding means for, on the basis of compression codes generated on the compressing side for the respective 
patterns of different types, searching for code vectors corresponding to the compression codes from the code 
books prepared for the respective patterns. 

58. A system for data compression/decompression according to claim 57, characterized in that each of said first and 
second code book storage means stores the code books of the different types of patterns in a single storage 
device. 

59. A system for data compression/decompression according to claim 57, characterized in that each of said first and 
second code book storage means separately stores the code books of the different types of patterns in storage 
devices, and 

information for identifying a pattern is supplied to said device for data decompression together with the code 
generated by said device for data compression. 

60. A computer-readable recording medium characterized in that said recording medium stores a program for causing 
a computer to function as each means according to claim 39. 

61. A computer-readable recording medium characterized in that said recording medium stores a program for causing 
a computer to realize the function according to any one of claims 40 to 44. 

62. A computer-readable recording medium characterized in that said recording medium stores a program for causing 
a computer to function as each means according to claim 46 or 49. 
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63. A computer-readable recording medium characterized in that said recording medium stores a program for causing 
a computer to execute a processing procedure of the method for data compression according to any one of claims 
50 to 53. 

5 64. A computer-readable recording medium characterized in that said recording medium stores a program for causing 
a computer to execute a processing procedure of the method for data decompression according to any one of 
claims 54 to 56. 



10 



15 



20 



25 



30 



35 



40 



45 



50 



30 



EP 1 087 533 A1 



F I G. 1 



1 

c^L 

START POINT SETTING 
SECTION 



: c£ 

INCREMENT SETTING 
SECTION 



^1 



GROUPING 
SECTION 



START 
POINT LUMINANCE 
VALUE SETTING 
SECTION 



CODE BOOK MAKING 
SECTION 



CODE BOOK 
DATA MEMORY 



31 



EP 1 087 533 A1 



F I G. 2 



( START ) 



DIVIDE 4X4 BLOCKS 
INTO SEVERAL GROUPS 
(GROUP COUNT N) 



S1 



GIVE INCREMENT (STEP) OF LUMINANCE 
BETWEEN ADJACENT GROUPS, 
i=0 



S2 



EQUALLY DIVIDE RANGE OF 
0 TO (225-(N-1)xSTEP) 
AND GIVE LUMINANCE VALUE AT 
START POINT TO GROUP SERVING 
AS START POINT 



-S3 



SHIFT TO ADJACENT GROUP, 
i=i+1 




-S4 



S6 



GIVE LUMINANCE VALUE (LUMINANCE 
VALUE OF GROUP AT START POINT 
+ixSTEP) TO CURRENT GROUP, 
i=i+1 



S7 



STORE GENERATED 
CODE VECTOR 
IN MEMORY 



( END ) 



32 




K K+40 




33 



EP 1 087 533 A1 




[8P] HNSd 



34 



EP 1 087 533 A1 



F I G. 5 



START POINT SETTING 






SECTION 








12 




13 










GROUPING 




DYNAMIC RANGE 


SECTION 




DIVIDING 






SECTION 








14 












CODE BOOK MAKING 






SECTION 







15 



CODE BOOK 
DATA MEMORY 



35 



EP 1 087 533 A1 



F I G. 6 



( START ) 



DIVIDE 4X4 BLOCKS 
INTO SEVERAL GROUPS 
(GROUP COUNT N) 



DIVIDE DYNAMIC RANGE OF 
LUMINANCE VALUES INTO 
N PARTS (So,Si,-,Sn-i), 
i=0 



GIVE LUMINANCE VALUE 
BELONGING TO So TO GROUP 
SERVING AS START POINT 



SHIFT TO ADJACENT GROUP, 
i=i+1 




-S11 



GIVE LUMINANCE VALUE 
BELONGING TO Si TO 
CURRENT GROUP, 
i=i+1 



-S12 



-S13 



S14 



S17 

r-L. 



STORE GENERATED 
CODE VECTOR 
IN MEMORY 



( END ) 



36 



EP 1 087 533 A1 




F I G. 7 




37 



EP 1 087 53S A1 



F I G. 8 



MINIMUM LUMINANCE 
RATIO SETTING 
SECTION 



21 



MAXIMUM/MINIMUM 
LUMINANCE VALUE SETTING 
SECTION 



22 



LUMINANCE VALUE 
CONVERSION 
SECTION 



23 



CODE BOOK 
DATA MEMORY 



38 



EP 1 087 533 A1 



F I G. 9 



( START ) 



DETERMINE RATIO OF 
BLACK IN 
4X4 BLOCK 



S21 



GIVE BLACE IN ACCORDANCE 
WITH RATIO AND GIVE WHITE 
TO OTHER PORTIONS 



S22 



S23 



BLACK DOTS 
□NEARLY OCCUPY 
4X4 BLOCK*. 



I YES 



CHAHGE WHITE DOT ADJACENT 
TO BLACK DOT TO HALFTONE 



^S24 



STORE GENERATED CODE 
VECTOR IN MEMORY 



S25 



C END ) 



39 



EP1 087 533 A1 




40 



fj 



EP 1 087 533 A1 



in 



ezz 



i mmm ' 4mwm \ 



2 
o 
o 



Si 
O o 

O m 
OS 

<: uj 



UJ 

O 
X 

o 



z 



to 
or 
or 

Q_ 

o 



o 

UJ 
Q 
O 
QQ 



to 



o 



in 

CM 



o in 

CM t- 



m 



( a p ) a n s d 



41 



EP1 087533 A1 



F I G. 12 



101 



START 
POINT 
DESIGNATING 
SECTION 





102 


GROL 
SEC 


IPING 

noN 



103 

.cL 



INCREMENT 
INPUT 
SECTION 



104 



START 
POINT 
LUMINANCE 
VALUE 
SETTING 
SECTION 



105 



PATTERN 
INPUT 
SECTION 




106 


QUANTIZING 
SECTION 




107 



MINIMUM 
LUMINANCE 
VALUE 
SUBTRACTING 
SECTION 



108 



LUMINANCE 
VALUE 
CHANGE 
SECTION 



109 



CODE BOOK MAKING SECTION 



110 
* cL 

CODE 

BOOK 
DATA 
MEMORY 



42 



EP 1 087 533 A1 



• 



F I G. 13 



121 



ORIGINAL 
IMAGE 
INPUT 

SECTION 



123 



SIMILARITY 
ARITHMETIC 
OPERATION 
SECTION 



124 



CODE 
DETERMINING 
SECTION 



CODE 



122 



CODE 

BOOK 
ARITHMETIC 
OPERATION 
SECTION 



110 



CODE 
BOOK 
DATA 
MEMORY 



43 




44 



EP 1 0S7 533*1 



F I G. 15 



Mi 










W 


































m 

















HB 
liflB 


m 


I I I 





■■ 

HB 

m a 


B 
B 
fl 


mm 

MM 


fl 




45 



EP 1 087 533 A1 



F I G. 16 



( START ) 



DIVIDE 4X4 BLOCKS INTO 
SEVERAL GROUPS 



S101 



DETERMINE INCREMENT (h) OF 
LUMINANCE VALUE AT END POINT 
VIEWED FROM START POINT 



EQUALLY DIVIDE RANGE OF 
0 TO (INTERMEDIATE VALUE-h) 
AND GIVE LUMINANCE VALUE 
AT START POINT 



^S102 



S103 



LINEARLY INTERPOLATE GROUPS OTHER 
THAN THOSE CORRESPONDING TO 
START POINT AND END POINT 


-~S104 








STORE GENERATED CODE BOOK 
IN MEMORY 


-~S105 







C END ) 



EP 1 087 533 A1 



F I G. 17 

( START ) 



CONSTITUTE LUMINANCE IN 
BLOCK WITH REFERENCE 
TO ORIGINAL IMAGE IN 
WHICH DIFFERENCE BETWEEN 
BLACK AND WHITE IS CLEAR 



^S111 



QUANTIZE LUMINANCE IN ORIGINAL IMAGE 



S112 



EXPRESS BLOCK BY ONLY INCREMENT h ^S1 13 



DECREASE ENTIRE LUMINANCE IN BLOCK 
TO GIVE VARIATIONS TO PATTERN 



S114 



EQUALLY DIVIDE RANGE OF 
0 TO (MAXIMUM VALUE -h') 
AND GIVE LUMINANCE VALUE 
AT START POINT 



^S115 



MAKE CODE BOOK ON THE BASIS OF 
LUMINANCE VALUE AT START POINT 



S116 



STORE GENERATED CODE BOOK IN MEMORY 







-S117 



( END ) 



47 



EP 1 087 533 A1 



F I G. 18 



( START ) 







INPUT ORIGINAL IMAGE ~S121 






READ CODE BOOK DATA "~S122 






PERFORM 90" ROTATION FOUR TIMES —S123 






INVERT WHITE AND BLACK ^S124 






PERFORM VQ ARITHMETIC OPERATION — S125 






OUTPUT CODE h^S126 







( END ) 



48 



EP 1 087 533 A1 



O 

CM' 



o 
p 

O 
UJ 
CO 

Ul 
O 
< 

to 

o 
o 

CO 

LU 
O 

o 
o 



co- 
rn 
o 
eg, 



I0K 


(d 
m 
o 


OK 




CMn 


o 




CD 


UJ 
O 




UJ 


o 




O 


o 




O 












or 


PA1 




PAT 


Q 




UJ 






o 


o 




Q 


CO 




UJ 



o 

CM 



8 

CN 



CL 



Ul 
O 
< 



o 

p 

o 

Ul 

CO 



o 

CM 



pp 

Ul o 
2 UJ 
jE CO 

p 

_J < 
^ or 



o 

CM' 



to 
o 

CM 



o 



ujP 
x o 
o ui 

CO ^ 
I 

8&s 

As 

88 



org 

CO O 
3 Ul 
^ CO 



83 



O 
P 

o 

UJ 

CO 

Ul 

< 

e 

to 

o 
o 

CD 

LU 
Q 
O 
O 



o 

CM. 



I0K 


-Q 
Oi 

o 


OK 


<_> 


CMv 


o 


03 


m 


Ul 




Ul 


Q 




Q 


O 




o 


O 




o 








a: 




a: 
p" 


PA1 




PAT 






Ul 






o 


o 




Q 


CO 




Ul 



5 

CM 

cr 



00 

o 

CM 



ui 2 

CD P 
2 O 

r> ui 

Z CO 



O P- 



CM 
CI 



Ul 
UJ 

o 

CO 

I 

o 
o 
m 
l 

ui 
o 

O 

a 



o 

P 

o 

Ul 
CO 

o 
z 

175 

CO 
Ul 

cr 

CL 

O 

o 



CC 

OUJ 

< Ul 
CL 

couj 

s s 

uj a: 
o o 

< h- 



49 



EP1 087 533 A1 




5 

z — 



>- 

O . 

r> a: 
o 



O 
CM 

O 




50 




51 



EP 1 087 533 A1 



F I G. 22 



(START) 



CLEAR BLOCK 
COUNTER 



S201 



GIVE SEARCH 
THRESHOU3VALUE (Th) 



S202 



INPUT IMAGE BLOCK 



[MAXIMUM VALUL 
- MINIMUM VALUE) 
OF LUMINANCE VALUE 
IN BLOCK > ThL 



S204 



SEARCH FROM 
EDGE SECTION IN 
CODE BOOK (VQ) 



SEARCH FROM 
SOLID SECTION IN 
CODE BOOK (VQ) 



\7^S205 



ENCODING 

ZZEZ 



X/^S206 



\^S207 



OUTPUT CODE NUMBER 

X^S208 




INCREMENT BLOCK 
COUNTFR m ONF 



V^S210 



S209 



52 



EP 1 087 533 A1 



F I G. 23 



(START) 



CLEAR BLOCK 
COUNTER 



<AS211 



INPUT CODE NUMBER 



SEARCH FOR PATTERN 
CORRESPONDING TO 
CODE NUMBER TORM 
BOOK (VQ) 



S212 



S213 



DISPLYA OR STORE IMAGE 



INCREMENT BLOCK 
COUNTER BY. QNEl 

VT^S216 




53 



EP 1 087 533 A1 



t- CM 



2 
O 

go 

ZUJ 

ceo 

p 

no 
oo 
com 



o 
So 

oo 
oo 

UJCD 



og eg 



§ 

Olu 

ot/> 
ceo 

Q-co 

no 
oo 
com 



o 
So 

el 

UJ* 

oo 
oo 

UJ00 




ro 
o 
cm 



Q 
—J 


Ino 


O 


P 




o 




UJ 

CO 


UJ 


THR 


in 








Z 


o 


»— i 




UJ 


< 


3 


UJ 

CO 








2 



54 



EP 1 087 533 A1 



F I G. 25 



(§tarD 



CLEAR BLOCK 
COUNTER 



S201 



GIVE SEARCH 
THRESHOLD VALUE (Th) 



S202 



INPUT IMAGE BLOCK 



[MAXIMUM VALUE. 
- MINIMUM VALUE) 
OF LUMINANCE VALUE 
IN BLOCK > M 



S204 



SEARCH FROM 
EDGE PATTERN. CODE 
BOOK (VQ\Flaa=1 _ 

j XT -S221 
ENCODING 



SEARCH FROM 
SOLID PATTERN CODE] 
BOOK (VQ^Fiaq=M 



I 



S222 



\r^S207 



OUTPUT FLAG VALUE 
AND CODE NUMBER 




XT-S223 



S209 



INCREMENT BLOCK 
COUNTER BY ONE 



Vjr-S2 



10 



55 



EP 1 087 533 A1 



F I G. 26 



(START) 



CLEAR BLOCK 
COUNTER 



L 

S211 



INPUT Flag VALUE 



and" code Dumber 




SEARCH FOR PATTERN 
CORRESPONDING TO 
CODE NUMBER FORM 
EDGE PATTERN 
CODE BOOK (VQ) 



Xi^S226 




ISEARCH FOR PATTERN 
CORRESPONDING TO 
CODE NUMBER FORM 
SOUD PATTERN 
CODE BOOK (VQ) 



\T-S227 



INCREMENT BLOCK 
COUNTER BY ONE 



S214 



\r-S216 



S215 



56 



EP 1 087 533 A1 



F I G. 27 



F I G. 28 



IMAGE 
INPUT UNIT 



302^ 



COMPRESSING 
UNIT USING CODE 
BOOK SCHEME 



303 



CODE BOOK 
STORAGE UNIT 



CODE NUMBER 



57 



EP 1 087 533 A1 



F I G. 29 



DIRECTION OF CHANGE 
\OFENHRE LUMINANCE 




(a) 




DIRECTION OF 
LUMINANCE CHANCE 
IN BLOCK 



(b) 



58 



EP 1 087 533 A1 



INTERNATIONAL SEARCH REPORT 



International application No. 
PCT/JP99/02050 



A CLASSIFICATION OF SUBJECT MATTER 

Xttt. CI* H03K7/30, H04NI/41, H04N7/28 



According to jntengipnaj 



Qagificatoi (1PQ or to both 



classification and IPC 



a FIELDS SEARCHED 



Minimum documentation searched (classification system followed by classification symbols) 
Int .CI* H03M7/30 f H04N1/41-1/419, H04N7/24-7/68 



Documentation searched other 

Jitauyo Shinan 
Kbkai Jitauyo 



than minimum documentation to the extent that such documents are included in the t 

192e>1996 Itoroku Jitsuyo Shinan Xbho 1994-1999 
Kbho 1971-1999 Jitsuyo Shinan Tbrota Koto 1996-1999 



Electronic data base consulted daring the imemational learch (Bame of data base and, where practicable, search 



C DOCUMENTS CONSIDERED TO BE RELEVANT 



Category* 



Citation of document, with indication* where appropriate, of the relevant 



Relevant to daim Na 



JP, 6-164939, A (Fuji Xerox Co., Ltd.), 
10 Jane, 1994 (10. 06. 94), 
Column 8, line 37 to column 9, line 27 
(Family x none) 



Fig. 4 



JP, 64-82779, A (Canon Inc.), 
28 March, 19B9 (28. 03. 89), 

Page 5, lower right column, line 11 to page 6, 
line 15 ; page 8, upper left column, lines 1 to 12, 
upper right column, . lines 10 to 14 (Family: none) 



If 5, 6, 10, 

11, 15, 
18-31, 40-42, 
47, 51, 55, 61 

43, 44, 45, 48, 
49, 52, 53, 56 

2, 7, 12, 16, 
32-39, 46, 54, 
60, 62, 64 

1, 4-6, 9-11, 
14, 15, 17-31, 
40-42, 47, 51, 
v 55, 61 

43, 44, 45, 48, 
49, 52, 53, 56 




"A" anossBBM aeflalBittnaaaesal ate* at da an wafchfaaoi d»ie »nd w* in oaenjd wii* eke ^ytk»H o% b*i 10 

coaakkml to be o< partkmfrr irk naau. the srtaople <* fceory madtrlyiaf fka fawwak* 

TT carBer dacaaaaathmpnhlhtndoa or alter tbaintctan ttoa alOTaf; date "X" docaarcaa a! panlcaaw raawsacas tfca rhimad ia vaan aa caanat be 

"L* docuwti wak* *ny Owwr do«b* cm priority <tain*i) or wtxk* is coaaidttad novel or OMDdtba n isa wlm i rt la lavofrtaabfrtatrvcaep 

died i» catab&afc to pobBcxtio* itatoof csiihcTd&ttkmaretacr _ when Iht doeeaaaat • ttfcca aim 

(aa ajmiifluf) *Y" tiScsataaffjJ gswssi^ia*' jrefcs»%a«K t$£ dte#3«ed km?»5i&« **.as!0i be 




Om priority dttedahnnl 



filing date bm later tea 




Date of the acta*) coenpietion of the international search 
13 July, 1999 (13. 07. 99) 



Due of mailing of the international search report 
27 July, 1999 (27. 07. 99) 



Name and mailing address of the ISA/ 

Japanese Patent Office 

Facsimile Na 



Authorized officer 



Telephone No. 



Form PCT/ISA01O (second sheet) (July 1992) 



59 



